-- Logs begin at Sat 2022-06-18 04:08:00 UTC, end at Sat 2022-06-18 05:35:41 UTC. -- Jun 18 05:07:57.123326 dv-cinder-836996-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 18 05:07:57.131277 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 05:07:57 2022] *** Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: nodename: dv-cinder-836996-35-iscsi Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: machine: x86_64 Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: clock source: unix Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: pcre jit disabled Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: detected number of CPU cores: 4 Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: current working directory: / Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: detected binary path: /usr/bin/uwsgi-core Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: your processes number limit is 47680 Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: your memory page size is 4096 bytes Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: detected max file descriptor number: 2048 Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: lock engine: pthread robust mutexes Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: thunder lock: enabled Jun 18 05:07:57.134534 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 18 05:07:57.135408 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 05:07:57.178166 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: Python main interpreter initialized at 0x55e8d373a9c0 Jun 18 05:07:57.178166 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: python threads support enabled Jun 18 05:07:57.178166 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: your server socket listen backlog is limited to 100 connections Jun 18 05:07:57.178166 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: your mercy for graceful operations on workers is 90 seconds Jun 18 05:07:57.178551 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 05:07:57.178625 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: *** Operational MODE: preforking *** Jun 18 05:07:57.178850 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: *** uWSGI is running in multiple interpreter mode *** Jun 18 05:07:57.178850 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: spawned uWSGI master process (pid: 103611) Jun 18 05:07:57.179058 dv-cinder-836996-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 18 05:07:57.179808 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: spawned uWSGI worker 1 (pid: 103612, cores: 1) Jun 18 05:07:57.179954 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: spawned uWSGI worker 2 (pid: 103613, cores: 1) Jun 18 05:07:57.180880 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 05:07:57.835164 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 05:07:57.835760 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 05:07:58.974464 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:07:58.974464 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: from cryptography.utils import int_from_bytes Jun 18 05:07:59.042185 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:07:59.042185 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: from cryptography.utils import int_from_bytes Jun 18 05:07:59.042336 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:07:59.042336 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: from cryptography.utils import int_from_bytes Jun 18 05:07:59.042336 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:07:59.042336 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: from cryptography.utils import int_from_bytes Jun 18 05:08:01.505080 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 05:08:01.505766 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 05:08:01.505881 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 05:08:01.506206 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 05:08:01.506454 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 05:08:01.507096 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.507413 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.507729 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.508041 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 05:08:01.508980 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.509079 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 05:08:01.509166 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.509332 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.509457 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 05:08:01.509674 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.509788 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 05:08:01.509988 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 05:08:01.510079 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.510309 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.510405 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.510565 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.510687 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.510875 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511010 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511193 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-35-iscsi {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511330 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511511 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511659 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511812 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.511971 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.512114 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.512290 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.512424 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.512614 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.512706 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.512939 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.513030 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.513199 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.513292 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.513538 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.513824 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.513992 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-35-iscsi {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.514173 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.514293 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.514480 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.514607 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.514788 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.514907 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.515105 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.515226 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.515411 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.515507 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.515718 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.515810 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516023 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516131 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516325 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516520 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516625 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516828 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.516921 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.517130 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.517300 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-35-iscsi {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.517467 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.517639 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.517804 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.517947 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.518114 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.518254 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.518422 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.518659 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.518799 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.518966 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.519062 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.519270 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.519370 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.519587 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.519697 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.519918 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520037 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-35-iscsi {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520219 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520317 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520539 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520638 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520852 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.520945 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.521167 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.521299 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.521511 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.521638 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.521811 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.521949 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.522113 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.522271 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.522439 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.522601 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.522716 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.522908 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523000 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523233 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523328 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523538 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523630 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523839 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.523996 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.524210 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.524316 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.524493 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.524743 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.524831 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525065 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525168 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525316 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525441 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525587 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525717 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.525910 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526025 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526225 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526338 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526531 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526628 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526834 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.526922 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527136 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527232 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527436 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527522 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527730 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527824 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.527984 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.528071 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.528302 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.528396 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.528598 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.528689 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.528913 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529006 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529216 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529315 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529549 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529650 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529849 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.529955 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.530154 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.530263 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.530456 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.530551 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.530762 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.530847 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531063 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531157 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531380 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531471 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531692 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531786 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.531995 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.532086 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.532302 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.532386 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.532615 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.532706 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.532916 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533002 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533308 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533541 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533628 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533854 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.533949 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.534181 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.534282 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.534482 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.534580 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.534728 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.534822 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535023 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535116 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535322 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535421 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535640 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535726 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.535939 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536030 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536246 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536345 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536538 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536623 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536833 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.536919 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.537132 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.537229 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.537452 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.537553 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.537752 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.537836 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538050 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538148 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538347 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538434 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538644 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538737 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.538942 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.539035 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.539240 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.539325 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.540127 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.540291 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.540477 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.540615 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.540859 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.540953 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.541172 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.541264 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.541515 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.541616 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.541824 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.541910 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.542126 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.542214 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.542432 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.542524 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.542733 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.542817 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543035 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543121 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543353 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543440 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543658 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543748 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.543958 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.544051 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.544262 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.544353 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.544566 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.544682 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.544973 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.545066 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.545284 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.545370 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.545620 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.545713 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.545943 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546028 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546252 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546348 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546561 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546692 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546865 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.546962 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.547164 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.547256 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.547465 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.547552 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.547766 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.547863 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548067 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548152 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548365 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548457 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548666 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548765 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.548964 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.549050 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.549268 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.549359 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.549608 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.549778 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.549915 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550008 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550218 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550310 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550518 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550613 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550822 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.550907 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.551153 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.551239 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.551456 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.551542 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.551777 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.551861 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.552115 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.552226 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.552429 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.552569 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.552736 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.553048 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.553219 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.553404 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:08:01.553563 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.553756 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.553874 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.554090 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.554186 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.554434 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.554520 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.554752 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.554836 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.555077 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.555771 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.555956 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.556096 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.556278 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.556425 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.556604 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.556743 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.556918 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.557060 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.557231 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.557432 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.557576 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.557751 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.557884 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.558068 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.558195 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.558382 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.558509 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.558725 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.558856 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.559046 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.559167 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.559378 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.559503 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.559697 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.559844 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560016 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560152 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560336 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560472 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560647 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560788 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.560964 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.561094 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.561295 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.561413 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.561644 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.561740 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.561958 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.562045 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.562303 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.562402 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.562621 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.562714 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.562934 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563021 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563239 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563334 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563545 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563640 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563849 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.563935 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.564154 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.564251 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.564459 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.564552 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.564783 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.564868 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.565091 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.565202 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.565429 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.565520 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.565743 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.565830 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566056 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566144 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566368 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566461 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566674 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566761 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.566980 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567081 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567280 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567368 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567580 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567675 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567880 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.567966 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.568184 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.568269 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.568483 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.568620 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.568799 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.568886 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.569111 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.569196 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.569433 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.569533 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.569746 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.569831 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570053 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570144 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570359 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570454 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570662 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570772 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.570996 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.571198 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.571292 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.571519 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.571604 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.571847 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.571939 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.572173 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.572267 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.572484 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.572568 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.572789 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.572882 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.573090 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.573251 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.573426 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.573529 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.573730 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.573816 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574030 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574126 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574340 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574644 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574728 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.574949 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575036 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575251 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575336 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575555 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575650 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575872 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.575958 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.576178 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.576274 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.576489 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.576582 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.576817 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.576908 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.577125 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.577217 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.577468 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.577557 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.577784 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.577872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.578097 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.578183 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.578410 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.578504 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.578718 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.578803 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579025 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579110 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579326 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579420 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579625 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579711 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.579923 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580009 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580227 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580322 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580525 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580619 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580821 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.580921 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.581119 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.581219 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.581499 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.581591 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.581802 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.581898 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.582119 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.582207 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.582423 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.582507 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.582718 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.582803 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583016 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583103 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583312 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583403 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583613 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583697 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.583916 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584002 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584220 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584312 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584525 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584611 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584828 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.584914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.585149 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.585236 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.585483 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.585585 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.585787 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.585880 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.586090 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.586181 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.586421 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.586570 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.586731 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.586827 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587037 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587136 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587349 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587444 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587656 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587742 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.587970 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588056 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588275 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588370 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588594 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588681 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588898 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.588983 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.589207 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.589301 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.589529 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.589616 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.589841 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.589925 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.590151 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.590238 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.590470 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.590555 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.590781 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.590917 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.591095 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.591182 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.591400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.591483 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.591708 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.591793 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592012 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592099 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592316 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592401 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592618 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592701 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.592920 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593006 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593231 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593324 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593573 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593678 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593890 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.593976 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.594196 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.594282 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.594513 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.594606 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.594818 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.594911 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.595126 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.595230 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.595423 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.595520 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.595732 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.595825 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596043 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596146 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596361 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596456 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596665 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596757 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.596972 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.597065 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.597280 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.597425 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.597609 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.597706 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.597917 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598003 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598225 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598323 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598527 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598612 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598824 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.598964 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.599131 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.599218 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.599437 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.599531 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.599742 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.599842 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600048 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600136 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600350 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600442 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600662 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600749 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.600967 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.601054 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.601270 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.601364 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.601595 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.601770 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.601922 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.602604 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.602800 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.602919 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.603110 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.603207 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.603431 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.603525 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.603744 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.603838 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604045 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604138 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604347 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604433 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604661 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604746 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.604966 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605068 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605267 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605359 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605594 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605683 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605896 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.605984 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.606219 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.606302 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.606533 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.606625 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.606836 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.606929 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.607152 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.607237 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.607461 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.607546 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.607764 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.607850 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608073 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608158 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608377 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608460 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608680 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608772 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.608981 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.609071 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.609295 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.609416 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.609662 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.609748 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.609968 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610052 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610271 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610368 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610576 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610662 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610879 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.610965 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.611196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.611288 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.611500 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.611586 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.611807 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.611900 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.612112 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.612207 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.612413 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.612498 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.612719 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.612812 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.613029 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.613125 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.613345 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.613612 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.613703 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.613943 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614052 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614255 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614342 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614575 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614660 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614887 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.614988 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.615199 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.615286 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.615506 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.615592 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.615818 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.615913 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.616137 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.616223 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.616451 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.616698 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.616785 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.617034 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.617128 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.617333 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.617481 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.617802 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.617888 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.618126 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.618261 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.618435 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.618585 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.618742 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.618919 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619053 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619253 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619349 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619596 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619690 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619905 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.619992 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.620219 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.620314 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.620527 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.620612 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.620827 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.620921 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.621137 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.621224 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.621460 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.621561 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.621769 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.621854 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622075 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622161 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622376 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622462 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622675 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622768 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.622976 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623062 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623276 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623361 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623588 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623687 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623905 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.623992 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.624210 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.624295 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.624523 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.624621 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.624829 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.624922 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.625133 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.625225 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.625474 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.625576 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.625783 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.625875 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.626087 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.626179 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.626393 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.626553 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.626725 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.626811 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627028 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627119 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627325 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627411 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627633 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627725 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.627937 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628023 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628240 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628336 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628543 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628631 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628842 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.628928 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.629146 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.629280 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.629470 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.629576 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.629783 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.629871 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630087 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630173 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630384 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630478 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630683 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630779 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.630990 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.631076 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.631295 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.631380 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.631593 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.631935 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.632151 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.632235 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.632445 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.632538 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.632751 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.632845 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.633048 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.633185 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.633889 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.634037 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.634352 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.634597 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.634687 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.634916 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635002 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635227 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635329 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635542 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635635 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635847 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.635932 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.636150 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.636244 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.636451 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.636546 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.636753 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.636845 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637051 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637145 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637349 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637456 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637678 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637764 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.637982 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638080 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638295 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638388 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638594 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638679 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638900 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.638986 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.639198 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.639292 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.639498 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.639585 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.639798 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.639934 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640110 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640198 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640400 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640486 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640698 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640786 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.640998 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.641090 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.641294 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.641450 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.641618 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.641706 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.641941 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642052 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642252 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642357 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642551 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642641 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642852 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.642952 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.643151 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.643275 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.643454 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.643541 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.643767 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.643917 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644078 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644175 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644384 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644472 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644689 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644776 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.644997 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.645096 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.645301 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.645446 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.645631 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.645718 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.645942 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646029 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646245 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646332 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646549 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646634 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646856 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.646943 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.647160 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.647252 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.647464 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.647597 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.647766 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.647860 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.648083 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.648169 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.648392 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.648478 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.648700 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.648787 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.649077 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.649189 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.649544 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.649764 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.649855 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.650161 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.650358 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.650579 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.650685 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.650781 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651010 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651097 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651330 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651414 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651640 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651734 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.651946 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652032 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652251 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652335 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652555 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652647 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652863 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.652950 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.653169 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.653262 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.653496 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.653596 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.653805 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.653891 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.654112 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.654199 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.654415 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.654509 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.654737 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.654823 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655044 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655129 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655346 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655433 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655653 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655738 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.655954 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656040 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656261 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656566 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656651 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656876 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.656987 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.657192 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.657287 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.657531 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.657623 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.657843 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.657942 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.658157 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.658250 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.658470 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.658556 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.658777 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.658875 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.659084 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.659175 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.659386 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.659479 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.659701 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.659795 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660015 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660101 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660324 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660416 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660638 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660732 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.660947 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.661043 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.661250 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.661376 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.661584 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.661712 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.661905 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662028 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662207 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662336 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662507 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662648 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662808 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.662960 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.663128 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.663275 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.663427 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.663591 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.663743 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.663905 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.664155 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.664326 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.664965 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.665249 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.665598 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.665781 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.665914 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.666196 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.666285 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.666510 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.666595 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.666820 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.666913 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.667145 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.667231 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.667450 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.667543 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.667759 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.667844 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.668065 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.668151 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.668373 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.668459 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.668682 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.668769 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669003 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669090 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669324 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669437 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669658 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669757 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.669969 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.670066 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.670272 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.670438 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.670592 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.670754 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.670915 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.671068 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.671227 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.671395 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.671547 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.671721 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.671956 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672051 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672276 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672363 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672583 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672670 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672900 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.672996 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.673222 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.673308 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.673550 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.673650 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.673854 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.673950 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.674163 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.674250 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.674465 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.674552 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.674767 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.674855 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.675086 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.675180 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.675390 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.675476 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.675699 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.675787 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676006 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676120 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676312 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676445 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676613 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676758 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.676921 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.677081 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.677238 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.677427 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.677566 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.677739 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.677886 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678047 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678195 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678360 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678514 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678666 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678832 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.678974 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.679133 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.679299 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.679449 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.679607 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.679755 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.679923 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.680057 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.680815 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.680921 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.681131 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.681400 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.681495 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.681748 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.681849 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.682053 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.682141 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.682372 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.682465 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.682693 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.682780 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683010 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683097 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683315 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683407 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683645 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683732 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.683949 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684040 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684260 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684352 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684572 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684669 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684876 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.684961 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.685178 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.685264 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.685509 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.685598 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.685815 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.685900 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.686115 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.686213 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.686415 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.686501 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.686715 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.686813 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687023 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687119 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687322 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687409 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687619 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687705 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.687916 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688011 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688232 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688325 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688530 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688617 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688847 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.688934 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.689151 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.689236 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.689480 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.689568 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.689783 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.689872 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.690079 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.690165 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.690412 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.690499 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.690710 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.690798 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691017 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691102 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691322 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691409 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691627 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691715 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.691933 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692027 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692242 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692341 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692545 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692631 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692859 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.692944 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.693166 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.693297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.693496 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.693585 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.693801 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.693885 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.694104 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.694202 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.694411 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.694503 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.694720 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.694807 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695024 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695123 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695335 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695470 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695645 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695783 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.695986 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.696071 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.696319 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.696502 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.696645 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.696827 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.696959 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.697136 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.697271 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.697467 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.697616 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.697778 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.697934 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.698088 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.698251 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.698395 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.698568 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.698702 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.698884 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699007 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699195 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699311 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699514 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699610 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699830 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.699917 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.700148 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.700235 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.700535 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.700669 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.700866 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.700998 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.701178 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.701315 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.701513 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.701661 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.701826 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.701997 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.702129 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.702277 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.702473 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.702589 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.702782 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.702900 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.703084 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.703212 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.703394 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.703524 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.703702 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.703837 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704011 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704165 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704333 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704495 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704607 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704822 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.704909 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.705159 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.705248 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.705523 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.705615 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.705828 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.705915 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.706137 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.706239 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.706451 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.706539 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.706768 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.706855 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.707096 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.707185 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.707411 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.707498 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.707721 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.707820 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708031 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708118 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708344 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708477 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708654 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708855 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.708968 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.709166 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.709284 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.709520 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.709628 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.709844 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.709932 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.710163 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.710294 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.710478 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.710575 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.710789 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.710877 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.711110 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.711204 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.711437 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.711766 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.711856 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.711936 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712014 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712318 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712515 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712603 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712835 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.712930 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.713210 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.713356 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.713533 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.713698 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.713849 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.714036 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.714155 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.714370 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.714683 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.714771 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715001 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715087 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715319 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715414 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715646 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715734 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.715955 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716043 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716262 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716349 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716567 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716652 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716875 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.716960 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.717182 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.717269 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.717510 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.717600 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.717826 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.717924 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.718129 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.718216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.718428 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.718560 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.718729 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.718817 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.719038 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.719267 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.719353 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.719620 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.719706 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.719923 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720018 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720222 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720309 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720544 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720630 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720846 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.720934 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.721149 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.721236 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.721470 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.721558 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.721779 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.721869 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722079 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722167 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722380 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722466 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722679 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722767 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.722979 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723075 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723291 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723386 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723594 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723681 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723899 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.723987 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.724200 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.724300 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.724507 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.724593 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.724808 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.724893 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.725113 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.725208 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.725449 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.725539 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.725763 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.725861 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.726073 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.726169 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.726390 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.726475 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.726699 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.726785 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.727514 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.727675 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.727823 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728017 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728133 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728332 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728449 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728641 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728755 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.728983 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.729070 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.729299 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.729410 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.729686 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.729847 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.729994 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.730179 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.730306 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.730497 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.730663 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.730824 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.730988 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.731150 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.731295 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.731454 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.731603 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.731755 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.731921 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732056 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732232 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732379 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732687 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732871 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.732996 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.733182 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.733302 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.733563 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.733663 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.733885 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.733972 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.734222 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.734418 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.734512 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.734762 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.734849 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.735086 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.735174 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.735402 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.735495 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.735708 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.735795 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736013 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736100 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736315 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736409 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736620 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736706 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.736947 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737034 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737257 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737341 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737595 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737906 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.737999 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.738212 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.738297 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.738520 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.738615 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.738827 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.738952 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.739131 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.739217 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.739439 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.739537 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.739747 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.739833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740055 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740148 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740364 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740459 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740663 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740752 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.740970 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.741063 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.741284 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.741374 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.741660 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.741747 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.741980 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.742065 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.742296 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.742384 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.742636 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.743222 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.743531 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.743669 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.743847 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.743937 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.744161 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.744250 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.744475 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.744571 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.744794 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.744881 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.745112 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.745198 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.745472 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.745577 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.745782 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.745876 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.746084 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.746170 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.746386 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.746482 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.746695 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.746790 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747001 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747094 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747314 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747402 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747617 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747712 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.747919 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748006 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748217 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748306 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748521 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748607 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748820 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.748913 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.749122 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.749214 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.749447 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.749566 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.749752 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.749907 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750058 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750238 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750356 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750567 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750693 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750876 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.750972 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.751184 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.751270 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.751491 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.751579 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.751794 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.751880 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752109 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752194 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752406 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752490 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752703 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752799 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.752998 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.753085 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.753295 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.753440 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.753617 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.753705 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.753922 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754007 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754230 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754328 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754534 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754621 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754850 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.754935 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.755155 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.755250 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.755462 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.755555 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.755765 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.755850 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.756068 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.756166 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.756372 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.756458 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.756945 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757037 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757253 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757344 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757584 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757670 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757890 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.757976 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.758195 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.758322 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.758528 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.758676 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.758840 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.758977 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.759235 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.759325 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.759546 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.759633 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.759869 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.759965 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.760191 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.760278 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.760494 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.760581 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.760817 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.760912 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.761130 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.761224 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.761474 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.761576 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.761789 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.761890 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.762097 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.762184 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.762407 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.762492 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.762719 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.762813 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763024 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763112 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763336 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763429 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763638 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763731 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.763943 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764030 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764252 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764344 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764560 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764647 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764884 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.764973 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.765205 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.765299 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.765537 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.765637 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.765862 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.765955 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.766182 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.766276 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.766505 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.766593 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.766824 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.766911 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.767139 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.767235 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.767470 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.767555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.767781 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.767867 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.768089 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.768193 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.768393 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.768481 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.768633 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 05:08:01.768728 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.769001 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.769320 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.769667 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.769998 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.770329 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.770644 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.770974 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.771303 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.771655 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.771971 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.772316 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.772650 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.772968 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.773283 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.773620 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:08:01.773894 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 05:08:01.922660 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO dbcounter [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Registered counter for database nova_api Jun 18 05:08:01.927587 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO dbcounter [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Registered counter for database nova_api Jun 18 05:08:01.944643 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_db.sqlalchemy.engines [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:01.948501 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_db.sqlalchemy.engines [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:01.952085 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writer thread running {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:01.954995 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writer thread running {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.010037 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.context [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d1210af-aec7-4375-9a06-dcb0a464d0d2(cell1) {{(pid=103613) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 05:08:02.012953 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.context [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d1210af-aec7-4375-9a06-dcb0a464d0d2(cell1) {{(pid=103612) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 05:08:02.014000 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:08:02.015803 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:08:02.016589 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:08:02.017060 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_concurrency.lockutils [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:08:02.018579 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:08:02.018714 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_concurrency.lockutils [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:08:02.019530 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_concurrency.lockutils [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:08:02.020611 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO dbcounter [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Registered counter for database nova_cell0 Jun 18 05:08:02.021557 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_concurrency.lockutils [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:08:02.023568 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO dbcounter [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Registered counter for database nova_cell0 Jun 18 05:08:02.024911 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO dbcounter [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Registered counter for database nova_cell1 Jun 18 05:08:02.027688 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO dbcounter [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Registered counter for database nova_cell1 Jun 18 05:08:02.032279 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_db.sqlalchemy.engines [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:02.033415 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_db.sqlalchemy.engines [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:02.036108 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_db.sqlalchemy.engines [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:02.037073 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_db.sqlalchemy.engines [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:02.039830 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writer thread running {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.044010 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writer thread running {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.045211 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writer thread running {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.045529 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writer thread running {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.188042 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO dbcounter [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Registered counter for database nova_cell0 Jun 18 05:08:02.191857 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO dbcounter [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Registered counter for database nova_cell0 Jun 18 05:08:02.197467 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_db.sqlalchemy.engines [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:02.199993 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG oslo_db.sqlalchemy.engines [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:08:02.201865 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writer thread running {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.204335 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writer thread running {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:08:02.614156 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: WARNING keystonemiddleware.auth_token [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:08:02.621839 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: WARNING keystonemiddleware.auth_token [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:08:02.636185 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: WARNING keystonemiddleware.auth_token [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:08:02.643357 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: WARNING keystonemiddleware.auth_token [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:08:02.960815 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: WARNING keystonemiddleware.auth_token [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:08:02.967410 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: WARNING keystonemiddleware.auth_token [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:08:02.972690 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8d373a9c0 pid: 103613 (default app) Jun 18 05:08:02.974792 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:08:02.975981 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jun 18 05:08:02.976399 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sat Jun 18 05:08:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:08:02.989928 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: WARNING keystonemiddleware.auth_token [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:08:02.995183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: WARNING keystonemiddleware.auth_token [None req-7b55d4ca-c8c1-4676-9d60-a8fb5c74ab58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:08:03.000475 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8d373a9c0 pid: 103612 (default app) Jun 18 05:09:20.964759 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:20.966517 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Jun 18 05:09:20.967254 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:20.979843 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writing DB stats nova_api:SELECT=3 {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:20.980906 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writing DB stats nova_cell0:SELECT=3 {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:20.981645 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writing DB stats nova_cell1:SELECT=3 {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:20.983203 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:21.441049 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-dcf5de84-8297-4757-bba6-954b7cf99933 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:21.471447 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-dcf5de84-8297-4757-bba6-954b7cf99933 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.497404 Jun 18 05:09:21.472364 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 05:09:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:23.564012 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:23.565009 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-ed20d4df-3f3e-4b2b-9bbd-25dc8c72a800 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 18 05:09:23.565430 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:23.632714 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-05eaa513-1ebd-4d1a-bc34-22fd03660a3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:23.653299 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:09:23.653299 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: warnings.warn(msg) Jun 18 05:09:23.748601 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-05eaa513-1ebd-4d1a-bc34-22fd03660a3d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.177245 Jun 18 05:09:23.750515 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:23.763815 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_api:SELECT=3 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:23.765037 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_cell1:SELECT=3 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:23.766134 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_cell0:SELECT=3 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:23.766972 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:09:23.975303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-7127c26c-eb4e-4bd0-9b55-79089c4ca02c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:23.978344 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:09:23.978344 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: warnings.warn(msg) Jun 18 05:09:24.133601 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-7127c26c-eb4e-4bd0-9b55-79089c4ca02c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.375837 Jun 18 05:09:24.134789 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 05:09:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:26.278000 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-05eaa513-1ebd-4d1a-bc34-22fd03660a3d admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:26.279109 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-05eaa513-1ebd-4d1a-bc34-22fd03660a3d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jun 18 05:09:26.279546 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:26.402112 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-11d8eb16-e3ea-4367-a8ad-30a282f3177c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:26.420647 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:09:26.420647 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: warnings.warn(msg) Jun 18 05:09:26.516300 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-11d8eb16-e3ea-4367-a8ad-30a282f3177c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.230595 Jun 18 05:09:26.516746 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:26.529414 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-889ffeac-3b0f-43fd-a5c1-c8065fe8f0a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:26.530902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:09:26.530902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: warnings.warn(msg) Jun 18 05:09:26.619779 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-889ffeac-3b0f-43fd-a5c1-c8065fe8f0a9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094102 Jun 18 05:09:26.620604 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 05:09:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:09:28.705782 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-11d8eb16-e3ea-4367-a8ad-30a282f3177c admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:28.706791 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-11d8eb16-e3ea-4367-a8ad-30a282f3177c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jun 18 05:09:28.707187 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:28.769363 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-f59a6678-65d0-4a76-af4e-2ec315a26816 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:28.857484 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-f59a6678-65d0-4a76-af4e-2ec315a26816 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143868 Jun 18 05:09:28.858407 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 05:09:28.870635 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-de51b804-aa32-47d0-85ce-823689bcf5e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:28.952986 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-de51b804-aa32-47d0-85ce-823689bcf5e9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086595 Jun 18 05:09:28.953850 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 05:09:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:31.098775 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-f59a6678-65d0-4a76-af4e-2ec315a26816 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:31.098775 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-f59a6678-65d0-4a76-af4e-2ec315a26816 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 18 05:09:31.098775 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:31.151481 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-65283f86-fb7c-487d-a57a-690113614f21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "name": "ds2G", "id": "d3", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:31.227881 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-65283f86-fb7c-487d-a57a-690113614f21 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131537 Jun 18 05:09:31.228424 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:31.240379 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-b3becc94-df1f-4a8b-b9f5-75ae85ee06b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:31.342746 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-b3becc94-df1f-4a8b-b9f5-75ae85ee06b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106013 Jun 18 05:09:31.343796 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 05:09:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:33.459956 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-65283f86-fb7c-487d-a57a-690113614f21 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:33.460975 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-65283f86-fb7c-487d-a57a-690113614f21 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 18 05:09:33.462175 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:33.527761 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-1a5c0858-376f-44fb-8320-50bb601a87d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "vcpus": 4, "id": "d4"}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:33.589462 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-1a5c0858-376f-44fb-8320-50bb601a87d3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121302 Jun 18 05:09:33.590577 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 05:09:33.603701 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-38b9cd2c-8f08-4b35-857b-a7e55e0ae097 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:33.668289 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-38b9cd2c-8f08-4b35-857b-a7e55e0ae097 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069288 Jun 18 05:09:33.669185 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 05:09:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:35.768231 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-1a5c0858-376f-44fb-8320-50bb601a87d3 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:35.769266 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-1a5c0858-376f-44fb-8320-50bb601a87d3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 18 05:09:35.769695 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:35.829066 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-d4ff0c34-a138-44a9-8432-4bed2abbe005 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:35.852102 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-d4ff0c34-a138-44a9-8432-4bed2abbe005 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076571 Jun 18 05:09:35.852692 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 05:09:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:09:38.057871 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-1a5c0858-376f-44fb-8320-50bb601a87d3 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:38.058882 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-1a5c0858-376f-44fb-8320-50bb601a87d3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Jun 18 05:09:38.059274 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:38.119278 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-efd26839-dd17-4bc1-b8c2-eaedd27a8b52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "id": "1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:38.194207 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-efd26839-dd17-4bc1-b8c2-eaedd27a8b52 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.128790 Jun 18 05:09:38.194857 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:38.211015 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-912966d7-9a27-4a08-910a-075e99b6b82c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:38.290612 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-912966d7-9a27-4a08-910a-075e99b6b82c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082834 Jun 18 05:09:38.291288 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 05:09:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:09:40.705528 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-efd26839-dd17-4bc1-b8c2-eaedd27a8b52 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:40.706618 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-efd26839-dd17-4bc1-b8c2-eaedd27a8b52 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jun 18 05:09:40.707051 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:40.773884 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-0b15f234-a957-4960-a741-862e81415ed4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:40.937193 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-0b15f234-a957-4960-a741-862e81415ed4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.223563 Jun 18 05:09:40.939416 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:40.949843 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-2eb3f215-91f2-4578-8b13-319f802ca887 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:41.034335 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-2eb3f215-91f2-4578-8b13-319f802ca887 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088170 Jun 18 05:09:41.034943 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 05:09:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:43.175393 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-0b15f234-a957-4960-a741-862e81415ed4 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:43.176414 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-0b15f234-a957-4960-a741-862e81415ed4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 18 05:09:43.176822 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:43.236667 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-c995cba1-fc9f-470e-a277-6b898ef3f6b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:43.313874 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-c995cba1-fc9f-470e-a277-6b898ef3f6b5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.130321 Jun 18 05:09:43.314427 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:43.326686 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-acdd0391-bd5d-4c5f-9e85-330d08bcd91d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:43.408969 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-acdd0391-bd5d-4c5f-9e85-330d08bcd91d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085831 Jun 18 05:09:43.409661 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 05:09:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:09:45.645339 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-c995cba1-fc9f-470e-a277-6b898ef3f6b5 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:45.646550 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-c995cba1-fc9f-470e-a277-6b898ef3f6b5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jun 18 05:09:45.647041 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:45.707870 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-de0dfb3d-9ef1-4b4e-9a1d-0f2953115577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:45.828002 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-de0dfb3d-9ef1-4b4e-9a1d-0f2953115577 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.173791 Jun 18 05:09:45.828554 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:45.840879 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-1d8510ee-5679-42a4-b933-2a9334ba3e51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:45.940633 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-1d8510ee-5679-42a4-b933-2a9334ba3e51 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103910 Jun 18 05:09:45.953409 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 05:09:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:09:48.045721 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-de0dfb3d-9ef1-4b4e-9a1d-0f2953115577 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:09:48.047401 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-de0dfb3d-9ef1-4b4e-9a1d-0f2953115577 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Jun 18 05:09:48.047808 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:09:48.111594 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-54c70837-8f5f-4b95-8b77-2e6db062d164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5"}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:48.183196 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-54c70837-8f5f-4b95-8b77-2e6db062d164 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.129533 Jun 18 05:09:48.184159 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 05:09:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:09:48.195777 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-4ae1d1c4-6b26-4258-b0ab-4c746c7defbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:09:48.261946 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-4ae1d1c4-6b26-4258-b0ab-4c746c7defbc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069627 Jun 18 05:09:48.262454 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 05:09:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:10:12.709303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-54c70837-8f5f-4b95-8b77-2e6db062d164 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:12.710353 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-54c70837-8f5f-4b95-8b77-2e6db062d164 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 18 05:10:12.710744 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:12.721577 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:10:12.770017 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-3c8137a0-b948-4575-bd2f-1d6e04158978 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:12.787497 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-3c8137a0-b948-4575-bd2f-1d6e04158978 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070533 Jun 18 05:10:12.788029 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 05:10:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:10:13.720594 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-54c70837-8f5f-4b95-8b77-2e6db062d164 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:13.721660 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-54c70837-8f5f-4b95-8b77-2e6db062d164 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 18 05:10:13.722056 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:13.914947 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-75cf034f-1035-490c-8e42-85096560d04d admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:13.921314 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.wsgi [None req-75cf034f-1035-490c-8e42-85096560d04d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-75cf034f-1035-490c-8e42-85096560d04d admin admin] Request method failure captured: Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Accept: application/json Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Accept-Encoding: gzip, deflate Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Connection: keep-alive Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Content-Length: 0 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Host: 10.222.0.23 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Openstack-Api-Version: compute 2.90 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Openstack-System-Scope: None Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: User-Agent: python-novaclient Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Auth-Token: gAAAAABirV41VmQMjGMjym7f53DF4675D2QaQ1rRFC8vC_8OIVdU4ENmMO6Cw-61HPbtprt6yFcvvIoldhKlnxzQD_rcF3X6UCcD_fqHJcbi5z14WE6-PovCJGyjb2po3DdVVNFvxN171igQyr7Pa1OIIlGJgth9_ohTT8yQKzNbIW-Scw-x1U8 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Domain-Id: None Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Domain-Name: None Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Identity-Status: Confirmed Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Is-Admin-Project: True Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Domain-Id: default Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Domain-Name: Default Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Name: admin Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Role: reader,admin,member Jun 18 05:10:13.924555 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Roles: reader,admin,member Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d587d7347f6f4de2882df28dc6b6a574"}]}] Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant: admin Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant-Name: admin Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User: admin Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Domain-Id: default Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Domain-Name: Default Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Id: 5d3e83f3ca7347dea1350fa29bac5d9d Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Name: admin Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: method: > Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: exception: Flavor 42 could not be found. Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: action_args: {'id': '42'} Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:10:13.926156 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:13.927223 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:13.928609 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-75cf034f-1035-490c-8e42-85096560d04d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:10:13.929949 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-75cf034f-1035-490c-8e42-85096560d04d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062506 Jun 18 05:10:13.929949 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 05:10:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 05:10:13.935725 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-c885d3cb-3df9-42a3-a0e6-dba6913b8b56 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:13.938729 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:10:13.957108 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-c885d3cb-3df9-42a3-a0e6-dba6913b8b56 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025132 Jun 18 05:10:13.957667 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 05:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:10:13.967809 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-c1172cd5-28db-4629-87b9-45f812dc357d admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:13.990455 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-c1172cd5-28db-4629-87b9-45f812dc357d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026655 Jun 18 05:10:13.990982 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 05:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:10:14.000824 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-b72f5f88-bd4d-4267-975d-8844050b5fe3 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:14.007064 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.wsgi [None req-b72f5f88-bd4d-4267-975d-8844050b5fe3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-b72f5f88-bd4d-4267-975d-8844050b5fe3 admin admin] Request method failure captured: Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Accept: application/json Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Accept-Encoding: gzip, deflate Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Connection: keep-alive Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Content-Length: 0 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Host: 10.222.0.23 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Openstack-Api-Version: compute 2.90 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Openstack-System-Scope: None Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: User-Agent: python-novaclient Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Auth-Token: gAAAAABirV41VmQMjGMjym7f53DF4675D2QaQ1rRFC8vC_8OIVdU4ENmMO6Cw-61HPbtprt6yFcvvIoldhKlnxzQD_rcF3X6UCcD_fqHJcbi5z14WE6-PovCJGyjb2po3DdVVNFvxN171igQyr7Pa1OIIlGJgth9_ohTT8yQKzNbIW-Scw-x1U8 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Domain-Id: None Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Domain-Name: None Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Identity-Status: Confirmed Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Is-Admin-Project: True Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Domain-Id: default Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Domain-Name: Default Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Name: admin Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Role: reader,admin,member Jun 18 05:10:14.010444 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Roles: reader,admin,member Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d587d7347f6f4de2882df28dc6b6a574"}]}] Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant: admin Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant-Name: admin Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User: admin Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Domain-Id: default Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Domain-Name: Default Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Id: 5d3e83f3ca7347dea1350fa29bac5d9d Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Name: admin Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: method: > Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: exception: Flavor 42 could not be found. Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: action_args: {'id': '42'} Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:10:14.012872 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:14.013914 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:14.015216 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-b72f5f88-bd4d-4267-975d-8844050b5fe3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:10:14.016394 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-b72f5f88-bd4d-4267-975d-8844050b5fe3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015308 Jun 18 05:10:14.016394 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 05:10:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 05:10:14.830387 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-c1172cd5-28db-4629-87b9-45f812dc357d admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:14.831417 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-c1172cd5-28db-4629-87b9-45f812dc357d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 18 05:10:14.831807 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:15.021351 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-58de9211-d9ff-4390-ab29-75edfee24eb1 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:15.029814 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.wsgi [None req-58de9211-d9ff-4390-ab29-75edfee24eb1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-58de9211-d9ff-4390-ab29-75edfee24eb1 admin admin] Request method failure captured: Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Accept: application/json Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Accept-Encoding: gzip, deflate Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Connection: keep-alive Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Content-Length: 0 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Host: 10.222.0.23 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Openstack-Api-Version: compute 2.90 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Openstack-System-Scope: None Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: User-Agent: python-novaclient Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Auth-Token: gAAAAABirV42W3-st5nEeTYxUq_9rtQzDXM2jEvEMq9PDKrTXgocUk32jVQC1eBPuEk1fmnlh3OSh1eq0_JH84TULz50i1iJVyH5nkh9jHGMkAO3Yf-x9GQ1NJQSa64KLHp1RoplEA770RxeO41XWxEpV_s11HISxG-9pnxkVGPqPKqakTL47m4 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Domain-Id: None Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Domain-Name: None Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Identity-Status: Confirmed Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Is-Admin-Project: True Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Domain-Id: default Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Domain-Name: Default Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Name: admin Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Role: reader,admin,member Jun 18 05:10:15.031303 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Roles: reader,admin,member Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d587d7347f6f4de2882df28dc6b6a574"}]}] Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant: admin Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant-Name: admin Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User: admin Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Domain-Id: default Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Domain-Name: Default Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Id: 5d3e83f3ca7347dea1350fa29bac5d9d Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Name: admin Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: method: > Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: exception: Flavor 84 could not be found. Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: action_args: {'id': '84'} Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:10:15.032901 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:15.036297 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.037432 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-58de9211-d9ff-4390-ab29-75edfee24eb1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:10:15.038560 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-58de9211-d9ff-4390-ab29-75edfee24eb1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062864 Jun 18 05:10:15.038560 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 05:10:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 05:10:15.042193 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-ea214173-278c-4ece-8c37-906c0da0d574 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:15.055680 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-ea214173-278c-4ece-8c37-906c0da0d574 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017070 Jun 18 05:10:15.056199 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 05:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:10:15.065311 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-d00dbdbb-bc4f-4eb0-a2db-b57bd3b8f9a0 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:15.079350 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-d00dbdbb-bc4f-4eb0-a2db-b57bd3b8f9a0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017419 Jun 18 05:10:15.079862 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 05:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:10:15.088902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-c3756a64-5ddf-42be-916e-64de2584c43c admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:15.095360 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.wsgi [None req-c3756a64-5ddf-42be-916e-64de2584c43c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-c3756a64-5ddf-42be-916e-64de2584c43c admin admin] Request method failure captured: Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Accept: application/json Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Accept-Encoding: gzip, deflate Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Connection: keep-alive Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Content-Length: 0 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Host: 10.222.0.23 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Openstack-Api-Version: compute 2.90 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Openstack-System-Scope: None Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: User-Agent: python-novaclient Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Auth-Token: gAAAAABirV42W3-st5nEeTYxUq_9rtQzDXM2jEvEMq9PDKrTXgocUk32jVQC1eBPuEk1fmnlh3OSh1eq0_JH84TULz50i1iJVyH5nkh9jHGMkAO3Yf-x9GQ1NJQSa64KLHp1RoplEA770RxeO41XWxEpV_s11HISxG-9pnxkVGPqPKqakTL47m4 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Domain-Id: None Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Domain-Name: None Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Identity-Status: Confirmed Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Is-Admin-Project: True Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Domain-Id: default Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Domain-Name: Default Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Name: admin Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Role: reader,admin,member Jun 18 05:10:15.096902 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Roles: reader,admin,member Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d587d7347f6f4de2882df28dc6b6a574"}]}] Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant: admin Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant-Name: admin Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User: admin Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Domain-Id: default Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Domain-Name: Default Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Id: 5d3e83f3ca7347dea1350fa29bac5d9d Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Name: admin Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: method: > Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: exception: Flavor 84 could not be found. Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: action_args: {'id': '84'} Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:10:15.098400 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:15.099183 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:15.100349 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-c3756a64-5ddf-42be-916e-64de2584c43c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:10:15.101346 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-c3756a64-5ddf-42be-916e-64de2584c43c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012875 Jun 18 05:10:15.101346 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 05:10:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 18 05:10:15.914784 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-d00dbdbb-bc4f-4eb0-a2db-b57bd3b8f9a0 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:15.915800 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-d00dbdbb-bc4f-4eb0-a2db-b57bd3b8f9a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 18 05:10:15.916172 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:16.106077 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-80e8ef0d-02d0-4c03-bf8e-3809c3dc0266 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:16.111707 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.wsgi [None req-80e8ef0d-02d0-4c03-bf8e-3809c3dc0266 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-80e8ef0d-02d0-4c03-bf8e-3809c3dc0266 admin admin] Request method failure captured: Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Accept: application/json Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Accept-Encoding: gzip, deflate Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Connection: keep-alive Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Content-Length: 0 Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Host: 10.222.0.23 Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Openstack-Api-Version: compute 2.90 Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Openstack-System-Scope: None Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: User-Agent: python-novaclient Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Auth-Token: gAAAAABirV43_QxwWTcrsrpJethVk6O7nKrK0Px8yOsr60Pk3d11OxRTNXzKUMCptzoyHpxgIc6LKnx9EcZtjZMRrZjvFobY36ExWLju_J0JM7D6EfN-OfIlVwUG4aSUYiCzBPULnB6aVqifA-7r1HFGsBlrqitLP0PwqarA6cpJbmH68OvKhuU Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Domain-Id: None Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Domain-Name: None Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Identity-Status: Confirmed Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Is-Admin-Project: True Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Domain-Id: default Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Domain-Name: Default Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Project-Name: admin Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Role: reader,admin,member Jun 18 05:10:16.113196 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Roles: reader,admin,member Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d587d7347f6f4de2882df28dc6b6a574"}]}] Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant: admin Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-Tenant-Name: admin Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User: admin Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Domain-Id: default Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Domain-Name: Default Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Id: 5d3e83f3ca7347dea1350fa29bac5d9d Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: X-User-Name: admin Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: method: > Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: exception: Flavor 451 could not be found. Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: action_args: {'id': '451'} Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:10:16.114696 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:16.115578 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.116833 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-80e8ef0d-02d0-4c03-bf8e-3809c3dc0266 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:10:16.118210 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-80e8ef0d-02d0-4c03-bf8e-3809c3dc0266 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060410 Jun 18 05:10:16.118210 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 05:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 05:10:16.125335 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-f52a4c2c-b316-4bf6-8a2f-f94930973b1e admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:16.140082 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-f52a4c2c-b316-4bf6-8a2f-f94930973b1e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019390 Jun 18 05:10:16.140603 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 05:10:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:10:16.149862 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:16.163451 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017045 Jun 18 05:10:16.163961 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 05:10:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:10:16.173219 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-dcb66605-d65a-4577-ade1-f64407470f1f admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:16.178544 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.wsgi [None req-dcb66605-d65a-4577-ade1-f64407470f1f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-dcb66605-d65a-4577-ade1-f64407470f1f admin admin] Request method failure captured: Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Accept: application/json Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Accept-Encoding: gzip, deflate Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Connection: keep-alive Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Content-Length: 0 Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Host: 10.222.0.23 Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Openstack-Api-Version: compute 2.90 Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Openstack-System-Scope: None Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: User-Agent: python-novaclient Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Auth-Token: gAAAAABirV43_QxwWTcrsrpJethVk6O7nKrK0Px8yOsr60Pk3d11OxRTNXzKUMCptzoyHpxgIc6LKnx9EcZtjZMRrZjvFobY36ExWLju_J0JM7D6EfN-OfIlVwUG4aSUYiCzBPULnB6aVqifA-7r1HFGsBlrqitLP0PwqarA6cpJbmH68OvKhuU Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Domain-Id: None Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Domain-Name: None Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Identity-Status: Confirmed Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Is-Admin-Project: True Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Domain-Id: default Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Domain-Name: Default Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Project-Name: admin Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Role: reader,admin,member Jun 18 05:10:16.180033 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Roles: reader,admin,member Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d587d7347f6f4de2882df28dc6b6a574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d587d7347f6f4de2882df28dc6b6a574"}]}] Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant: admin Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant-Id: d587d7347f6f4de2882df28dc6b6a574 Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-Tenant-Name: admin Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User: admin Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Domain-Id: default Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Domain-Name: Default Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Id: 5d3e83f3ca7347dea1350fa29bac5d9d Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: X-User-Name: admin Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: method: > Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: exception: Flavor 451 could not be found. Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: action_args: {'id': '451'} Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:10:16.181515 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:16.182627 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: ERROR nova.api.openstack.wsgi Jun 18 05:10:16.184688 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-dcb66605-d65a-4577-ade1-f64407470f1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:10:16.186111 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-dcb66605-d65a-4577-ade1-f64407470f1f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011660 Jun 18 05:10:16.186111 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 05:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 05:10:16.994951 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:16.995956 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 18 05:10:16.996983 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:17.185463 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-d6c9b2fe-fa77-48cf-8308-fc8710c1d64a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:10:17.255690 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-d6c9b2fe-fa77-48cf-8308-fc8710c1d64a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.122607 Jun 18 05:10:17.256209 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 05:10:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:10:18.078472 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:18.079480 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 18 05:10:18.079877 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:18.273214 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-4f6351cc-3d4a-45fc-9c97-9e625fb79665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:10:18.389229 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-4f6351cc-3d4a-45fc-9c97-9e625fb79665 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.167998 Jun 18 05:10:18.389720 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 05:10:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:10:19.238579 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:19.239577 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 18 05:10:19.239964 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:19.439538 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-286fe51b-6a22-4192-b24e-02919e22e776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:10:19.507466 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-286fe51b-6a22-4192-b24e-02919e22e776 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.119322 Jun 18 05:10:19.508010 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 05:10:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:10:20.315232 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:20.316238 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 18 05:10:20.316636 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:20.507352 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-d0a2670c-8d00-49d3-91fa-d78dcd9cbab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:10:20.576404 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-d0a2670c-8d00-49d3-91fa-d78dcd9cbab5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.122043 Jun 18 05:10:20.577758 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 05:10:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:10:21.396448 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:21.397495 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 18 05:10:21.397892 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:10:21.589411 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-aac4a253-37ee-473f-baeb-cc6ce8c24a32 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:10:21.608759 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-aac4a253-37ee-473f-baeb-cc6ce8c24a32 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073485 Jun 18 05:10:21.609207 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sat Jun 18 05:10:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:11:08.152986 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:11:08.154700 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-647ccb68-0b9a-4ce6-95cc-3eeaee803162 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 18 05:11:08.155089 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 05:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:11:08.165173 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:11:08.213372 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-28a5b826-80d8-418c-b9ea-deaa8b2bd86a admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:11:08.232610 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-28a5b826-80d8-418c-b9ea-deaa8b2bd86a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071867 Jun 18 05:11:08.233141 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 05:11:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:11:08.259085 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-c8b5678d-c093-4a07-ad30-a2145216f92b admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:11:08.262543 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG dbcounter [-] [103612] Writing DB stats nova_api:SELECT=14 {{(pid=103612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:11:08.268343 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-c8b5678d-c093-4a07-ad30-a2145216f92b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012986 Jun 18 05:11:08.268865 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Sat Jun 18 05:11:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:11:08.281408 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-65058413-a34f-44ab-b92e-3cf902654e50 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:11:08.289108 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-65058413-a34f-44ab-b92e-3cf902654e50 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012599 Jun 18 05:11:08.289655 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Sat Jun 18 05:11:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:11:08.301620 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:11:08.308912 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011183 Jun 18 05:11:08.309445 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Sat Jun 18 05:11:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:11:08.320440 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-5c22d76d-2cf4-4126-ba40-59830c096b9a admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:11:08.328368 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-5c22d76d-2cf4-4126-ba40-59830c096b9a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011370 Jun 18 05:11:08.328878 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Sat Jun 18 05:11:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:14:29.818548 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:29.819574 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 18 05:14:29.820211 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:14:29.967875 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_api:SELECT=6 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:14:30.084788 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-c5ecc819-392d-46aa-ba6a-7dee3f085904 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:30.085995 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:14:30.085995 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: warnings.warn(msg) Jun 18 05:14:30.087195 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-c5ecc819-392d-46aa-ba6a-7dee3f085904 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:30.087630 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-c5ecc819-392d-46aa-ba6a-7dee3f085904 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:30.088437 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-c5ecc819-392d-46aa-ba6a-7dee3f085904 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:30.088861 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-c5ecc819-392d-46aa-ba6a-7dee3f085904 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:30.123263 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-c5ecc819-392d-46aa-ba6a-7dee3f085904 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156833 Jun 18 05:14:30.123814 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 05:14:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:14:30.955785 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:30.956781 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 18 05:14:30.957168 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:14:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:14:31.150717 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-53a0d434-42b6-432d-a919-da7ac790dc06 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:31.152018 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:14:31.152018 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: warnings.warn(msg) Jun 18 05:14:31.153404 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-53a0d434-42b6-432d-a919-da7ac790dc06 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:31.153854 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-53a0d434-42b6-432d-a919-da7ac790dc06 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:31.155559 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-53a0d434-42b6-432d-a919-da7ac790dc06 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:31.155559 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-53a0d434-42b6-432d-a919-da7ac790dc06 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:31.175951 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-53a0d434-42b6-432d-a919-da7ac790dc06 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077835 Jun 18 05:14:31.176464 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 05:14:31 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:14:42.450851 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:42.451855 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 18 05:14:42.452244 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:14:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:14:42.598734 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_cell0:SELECT=4 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:14:42.599455 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_cell1:SELECT=4 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:14:42.600221 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG dbcounter [-] [103613] Writing DB stats nova_api:SELECT=8 {{(pid=103613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:14:42.651652 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-39548a5a-3e95-40bd-99b8-f8e01c0cb7a4 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:42.652841 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:14:42.652841 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: warnings.warn(msg) Jun 18 05:14:42.654068 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-39548a5a-3e95-40bd-99b8-f8e01c0cb7a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:42.654532 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-39548a5a-3e95-40bd-99b8-f8e01c0cb7a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:42.655308 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-39548a5a-3e95-40bd-99b8-f8e01c0cb7a4 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:42.655731 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-39548a5a-3e95-40bd-99b8-f8e01c0cb7a4 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:42.682641 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-39548a5a-3e95-40bd-99b8-f8e01c0cb7a4 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088436 Jun 18 05:14:42.683512 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 05:14:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:14:43.506341 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: DEBUG nova.api.openstack.wsgi [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] Calling method '>' {{(pid=103612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:43.507433 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: INFO nova.api.openstack.requestlog [None req-53da622a-4dd0-45e6-b5dd-f976016aa223 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Jun 18 05:14:43.507830 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: [pid: 103612|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 05:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:14:43.699703 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG nova.api.openstack.wsgi [None req-e5b22594-8e6d-4830-9e61-167b34764a54 admin admin] Calling method '>' {{(pid=103613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:14:43.700886 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 05:14:43.700886 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: warnings.warn(msg) Jun 18 05:14:43.702110 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-e5b22594-8e6d-4830-9e61-167b34764a54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:43.702543 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-e5b22594-8e6d-4830-9e61-167b34764a54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:43.703354 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-e5b22594-8e6d-4830-9e61-167b34764a54 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:14:43.703772 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: DEBUG oslo_concurrency.lockutils [None req-e5b22594-8e6d-4830-9e61-167b34764a54 admin admin] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:14:43.726040 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: INFO nova.api.openstack.requestlog [None req-e5b22594-8e6d-4830-9e61-167b34764a54 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078279 Jun 18 05:14:43.726590 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: [pid: 103613|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 05:14:43 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:15:38.950821 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: Sat Jun 18 05:15:38 2022 - graceful shutdown triggered... Jun 18 05:15:38.950958 dv-cinder-836996-35-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 18 05:15:38.951840 dv-cinder-836996-35-iscsi devstack@n-api.service[103612]: Gracefully killing worker 1 (pid: 103612)... Jun 18 05:15:38.952221 dv-cinder-836996-35-iscsi devstack@n-api.service[103613]: Gracefully killing worker 2 (pid: 103613)... Jun 18 05:15:39.952930 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: worker 1 buried after 1 seconds Jun 18 05:15:39.953494 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: worker 2 buried after 1 seconds Jun 18 05:15:39.953494 dv-cinder-836996-35-iscsi devstack@n-api.service[103611]: goodbye to uWSGI. Jun 18 05:15:39.954549 dv-cinder-836996-35-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 18 05:15:39.955098 dv-cinder-836996-35-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 18 05:15:39.957956 dv-cinder-836996-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 18 05:15:39.970752 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 05:15:39 2022] *** Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: nodename: dv-cinder-836996-35-iscsi Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: machine: x86_64 Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: clock source: unix Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: pcre jit disabled Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: detected number of CPU cores: 4 Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: current working directory: / Jun 18 05:15:39.972691 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: detected binary path: /usr/bin/uwsgi-core Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: your processes number limit is 47680 Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: your memory page size is 4096 bytes Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: detected max file descriptor number: 2048 Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: lock engine: pthread robust mutexes Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: thunder lock: enabled Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 18 05:15:39.973476 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 05:15:40.016865 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: Python main interpreter initialized at 0x55d7e4ab09c0 Jun 18 05:15:40.016865 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: python threads support enabled Jun 18 05:15:40.016865 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: your server socket listen backlog is limited to 100 connections Jun 18 05:15:40.016865 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: your mercy for graceful operations on workers is 90 seconds Jun 18 05:15:40.017334 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 05:15:40.017334 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: *** Operational MODE: preforking *** Jun 18 05:15:40.017609 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: *** uWSGI is running in multiple interpreter mode *** Jun 18 05:15:40.017609 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: spawned uWSGI master process (pid: 117972) Jun 18 05:15:40.017815 dv-cinder-836996-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 18 05:15:40.018444 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: spawned uWSGI worker 1 (pid: 117990, cores: 1) Jun 18 05:15:40.018731 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: spawned uWSGI worker 2 (pid: 117991, cores: 1) Jun 18 05:15:40.018912 dv-cinder-836996-35-iscsi devstack@n-api.service[117972]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 05:15:40.682046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 05:15:40.682713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 05:15:41.893344 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:15:41.893344 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: from cryptography.utils import int_from_bytes Jun 18 05:15:41.894068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:15:41.894068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: from cryptography.utils import int_from_bytes Jun 18 05:15:41.894637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:15:41.894637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: from cryptography.utils import int_from_bytes Jun 18 05:15:41.895053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 05:15:41.895053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: from cryptography.utils import int_from_bytes Jun 18 05:15:44.324111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 05:15:44.324698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 05:15:44.324908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 05:15:44.325275 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 05:15:44.325563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 05:15:44.325958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.326290 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.326622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.326945 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.327278 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.327609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.327913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.328233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.328563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.328826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.329143 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.329503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-35-iscsi {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.329833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.330145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.330461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.330784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.331091 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.331416 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.331724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.332233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.333480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.333480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.333480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.333731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.333943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.334254 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.334574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.334919 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.335247 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.335558 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.335970 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-35-iscsi {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.336290 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.336613 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.336928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.337356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.337704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.338018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.338342 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.338668 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.338979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.339307 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.339629 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.339949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.340270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.340574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.340887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.341198 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.341545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.341855 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.342163 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.342414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.342724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.343049 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.343369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.343694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.343947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.344198 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.344515 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.344836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.345146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.345495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.345809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.346118 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.346426 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.346739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.347046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.347358 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.347676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.347991 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.348314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.348623 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.348941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.349354 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.349630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.349943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.350806 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.351127 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.351438 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.351759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.352084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.352396 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.352705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.353016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.353336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.353700 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.354006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.354258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.354562 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.354870 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.355187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.355494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.355803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.356111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.356413 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.356720 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.357032 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.357339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.357675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.357983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.358285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.358593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.358900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.359203 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.359523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.359844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.360154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.360461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.360771 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.361080 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.361666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.361984 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.362294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.362618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.362927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.363237 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.363556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.363866 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.364175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.364494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.364621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 05:15:44.365091 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.365234 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 05:15:44.365370 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.365537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 05:15:44.365673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.365809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.365967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 05:15:44.366626 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 05:15:44.366757 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.366891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367714 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.367994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.368122 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.368315 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.368457 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.368616 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.368746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.368940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.369069 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.369264 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.369420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.369601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.369733 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.369867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370000 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370509 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-35-iscsi {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370835 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.370976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.371150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.371280 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.371466 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.371604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.371791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.371930 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.372101 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.372238 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.372430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.372569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.372741 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.372889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.373502 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.373638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.373772 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.373881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.374002 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.374113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.374220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.374335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.374443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.374557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.374677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.374826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.374953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.375141 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.375259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.375470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.375597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.375783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.375900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.376109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.376233 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.376422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.376537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.376805 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.376941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-35-iscsi {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.377072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.377213 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.377473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.377615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.377770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.377979 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.378116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.378258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.378393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.378529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.378656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.378781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.378965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.379106 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.379292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.379429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.379615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.379745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.379929 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.380068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.380241 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.380378 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.380555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.380685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.380878 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.381010 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.381210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.381341 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.381574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.381749 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.381980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.382186 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.382327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.382456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.382590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.382717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.382852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.382984 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.383112 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.383237 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.383371 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.383512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.383670 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.383809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.383998 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.384128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.384319 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.384458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.384588 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.384714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.384840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.384973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.385113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.385243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.385799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.385947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.386059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.386168 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.386285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.386406 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.386515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.386630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.386739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.386865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.387069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.387190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.387307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.387415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.387541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.387731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.387924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.388127 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.388241 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.388357 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.388465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.388582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.388786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.388902 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.389102 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.389234 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.389447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.389599 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.389799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.389936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.390096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.390231 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.390409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.390548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.390720 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.390859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.391026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.391165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.391350 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.391491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.391665 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.391803 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.391974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.392642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.392642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.392888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.393015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.393152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.393279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.393491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.393491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.393758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.393893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.394021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.394154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.394295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.394295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.394535 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.394662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.394795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.394922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.395062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.395208 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.395342 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.395476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.395613 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.395741 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.395867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.396002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.396129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.396517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.396652 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.396779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.396912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.397066 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.397210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.397468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.397603 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.397832 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.397982 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.398136 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.398332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.398463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.398589 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.398724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.398890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.399022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.399202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.399333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.399517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.399646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.399824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.399956 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.400133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.400264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.400441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.400572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.400749 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.400888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.401054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.401199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.401413 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.401634 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.401775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.401952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.402086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.402351 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.402493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.402620 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.402753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.402888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.403029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.403198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.403329 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.403531 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.403662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.403850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.403997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.404166 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.404304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.404492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.404631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.404801 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.404945 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.405115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.405245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.405452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.405605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.405769 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.405913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.406082 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.406213 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.406391 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.406528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.406703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.406842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.407015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.407152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.407325 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.407461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.407636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.407767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.407947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.408087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.408255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.408474 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.408618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.408742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.408852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.408967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.409168 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.409301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.409514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.409700 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.409840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.409975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.410139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 05:15:44.410271 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.410474 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.410612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.410789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.410922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.411106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.411251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.411418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.411557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.411732 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.411869 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.412046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.412191 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.412361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.412511 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.412682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.413355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.413599 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.413745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.413939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.414072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.414257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.414395 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.414621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.414751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.414882 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415513 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.415964 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.416158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.416294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.416481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.416629 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.416791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.416927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.417107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.417245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.417449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.417580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.417770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.417911 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.418085 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.418230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.418400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.418617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.418755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.418887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419013 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419411 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.419915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.420992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.421164 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.421293 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.421495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.421628 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.421803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.421942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.422119 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.422248 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.422445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.422575 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.422763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.422894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.423079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.423214 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.423395 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.423532 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.423700 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.423837 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424335 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424780 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.424958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.425096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.425279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.425449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.425597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.425726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.425912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426531 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.426988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.427153 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.427298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.427465 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.427600 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.427771 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.427900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.428088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.428232 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.428420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.429102 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.429334 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.429575 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.429709 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.429847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.429975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430236 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430521 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430652 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430837 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.430968 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.431153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.431278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.431482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.431622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.431798 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.431935 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.432105 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.432241 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.432417 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.432547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.432727 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.432859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.433037 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.433173 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.433353 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.433553 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.433682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.433951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.434082 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.434292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.434425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.434605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.434734 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.434926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.435064 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.435244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.435375 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.435562 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.435692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.435894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.436031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.436216 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.436347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.436535 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.436674 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.436860 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437004 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.437964 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.438142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.438282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.438453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.438598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.438761 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.438890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439065 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439412 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.439968 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.440099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.440274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.440407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.440579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.440710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.440891 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441516 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.441941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.442138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.442276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.442449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.442578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.442759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.442896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.443103 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.443237 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.443364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.443491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.443685 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.443830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.444009 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.444193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.444401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.444620 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.444764 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.444908 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.445036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.445198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.445329 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.445554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.445687 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.445879 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446205 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446651 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.446957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.447137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.447268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.447449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.447596 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.447761 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.447899 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.448074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.448210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.448385 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.448528 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.448699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.448837 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449144 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449523 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449854 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.449981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.450115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.450251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.450388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.450556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.450694 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.450863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451000 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451311 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451483 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.451923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.452098 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.452238 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.452410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.452541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.452718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.452859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453508 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.453979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.454112 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.454294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.454426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.454605 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.454745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.454909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455371 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455550 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455694 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.455988 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.456164 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.456296 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.456476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.456616 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.456783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.456914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.457090 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.457227 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.457443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.457597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.457753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.457884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458374 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.458997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.459133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.459307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.459445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.459612 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.459848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.459979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.460181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.460365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.460496 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.460624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.460802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.460933 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.461113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.461253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.461445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.461589 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.461762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.461899 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462206 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.462999 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.463130 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.463320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.463449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.463646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.463784 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.463977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.464108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.464290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.464427 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.464603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.464740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.464923 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.465053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.465238 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.465374 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.465559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.465702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.465872 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466485 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466797 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.466936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.467112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.467244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.467421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.467602 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.467740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.467875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468043 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468182 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468504 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468804 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.468988 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.469130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.469313 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.469472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.469657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.469786 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470412 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.470890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471334 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471515 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471829 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.471960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.472145 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.472283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.472458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.472603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.472767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.472905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.473078 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.473208 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.473422 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.473568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.473718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.473980 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.474111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.474320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.474450 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.474644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.474775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.474980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.475109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.475790 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.475927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.476113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.476325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.476470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.476599 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.476776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.476915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.477128 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.477272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.477466 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.477598 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.477774 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.477918 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.478087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.478226 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.478400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.478584 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.478713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.478838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.479018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.479149 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.479332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.479469 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.479643 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.479783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480306 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480583 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.480848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.481974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.482102 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.482258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.482403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.482586 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.482718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.482893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483025 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483200 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483831 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.483969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.484138 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.484269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.484461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.484591 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.484851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.484988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.485178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.485308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.485511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.485652 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.485845 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.485974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.486156 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.486287 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.486485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.486622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.486796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.486936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.487107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.487238 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.487415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.487545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.487730 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.487870 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488486 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488817 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.488991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.489134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.489305 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.489452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.489647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.489794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.489954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.490105 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.490301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.490436 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.490578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.490713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.490884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.491041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.491255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.491385 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.491567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.491760 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.491897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.492091 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.492232 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.492409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.492554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.492735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.492871 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.493065 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.493203 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.493375 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.493561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.493704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.493832 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494325 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494633 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.494947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.495075 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.495255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.495393 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.495562 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.495689 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.495876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496316 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496802 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.496929 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.497261 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.497410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.497539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.497677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.497812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.497953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498082 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498478 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.498970 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.499100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.499291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.499430 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.499603 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.499741 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.499914 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500433 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500564 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.500966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.501127 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.501256 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.501445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.501577 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.501759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.501898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.502065 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.502201 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.502394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.502539 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.502711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.502842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503024 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503469 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.503978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.504117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.504287 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.504420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.504593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.504725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.504906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.505046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.505216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.505346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.506111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.506251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.506381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507162 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507324 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507451 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.507983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508110 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508237 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.508908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509180 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509180 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509592 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.509898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510429 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.510910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511039 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511324 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.511954 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.512086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.512269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.512399 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.512584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.512723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.512900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.513030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.513218 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.513358 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.513559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.513690 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.513878 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514007 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514193 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514508 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514817 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.514954 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.515129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.515270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.515441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.515581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.515756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.515886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.516074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.516288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.516429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.516622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.516754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.516939 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.517085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.517257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.517422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.517598 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.517729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.517917 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.518059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.518235 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.518368 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.518557 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.518689 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.518872 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519012 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519500 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519631 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519832 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.519974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.520147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.520284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.520456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.520603 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.520809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.520949 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.521107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.521558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.521730 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.521862 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.522050 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.522224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.522432 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.522650 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.522850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.522990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523534 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523800 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.523937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.524066 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.524254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.524387 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.524584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.524726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.524894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.525026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.525220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.525357 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.525572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.525718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.525886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526516 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526680 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.526997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.527130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.527314 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.527457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.527644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.527776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.527973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.528112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.528306 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.528451 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.528619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.528750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.528938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.529191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.529337 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.529536 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.529670 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.529874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.530013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.530201 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.530343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.530528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.530667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.530889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531027 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531156 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531606 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.531917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.532086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.532227 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.532399 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.532529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.532712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.532842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533153 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.533967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.534109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.534289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.534427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.534619 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.534749 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.534995 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.535128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.535309 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.535467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.535639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.535780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.535953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.536090 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.536273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.536424 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.536592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.536737 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.536910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.537040 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.537221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.537352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.537557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.537699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.538415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.538607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.538787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.538926 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.539131 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.539276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.539462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.539601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.539797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.539928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.540112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.540256 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.540427 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.540559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.540736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.540868 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.541741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.541889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542028 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542156 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542156 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542560 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542695 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542695 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.542952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543222 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543493 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543627 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.543887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544810 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.544946 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545201 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545334 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545507 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.545904 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546291 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546562 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.546988 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.547128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.547299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.547438 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.547615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.547747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.547925 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548388 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548640 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.548988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.549162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.549301 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.549515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.549656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.549833 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.550120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.550263 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.550445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.550575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.550758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.550903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.551092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.551228 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.551407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.551535 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.551753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.551910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552048 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552175 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.552969 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.553108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.553283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.553471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.554177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.554394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.554553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.554759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.554890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.555088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.555233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.555415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.555553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.555737 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.555874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556052 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556192 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556510 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.556988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.557134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.557300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.557520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.557653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.557780 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.557973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.558180 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.558313 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.558519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.558657 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.558844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.558983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.559165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.559297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.559487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.559618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.559811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.559951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.560121 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.560252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.560433 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.560565 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.560749 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.560884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.561065 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.561204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.561377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.561566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.561704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.561853 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.562060 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.562199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.562374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.562514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.562720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.562852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.563046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.563176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.563370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.563508 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.563693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.563833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.564016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.564155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.564333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.564475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.564659 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.564789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.565016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.565159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.565335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.565503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.565682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.565813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566322 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566627 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566763 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.566935 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.567067 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.567242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.567375 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.567553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.567693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.567865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568305 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568611 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.568927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.569130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.569336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.569615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.569828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.569976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.570120 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.570250 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.570385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.570520 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.570649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.570777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571183 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571353 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.571971 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.572187 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.572328 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.572465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.572593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.572739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.572869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573004 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573489 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.573940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.574105 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.574244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.574410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.574555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.574748 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.574888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.575084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.575215 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.575403 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.575547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.575721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.575857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.576036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.576166 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.576350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.576480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.576659 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.576889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.577028 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.577249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.577408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.577597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.577741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.577928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.578994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.579181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.579321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.579495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.579626 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.579804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.579938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.580117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.580255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.580432 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.580563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.580743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.580875 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.581054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.581186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.581372 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.581531 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.581711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.581842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582024 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582173 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582370 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582788 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.582958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.583090 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.583268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.583398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.583578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.583717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.583886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.584016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.584196 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.584333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.584511 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.584669 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.585003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.585634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.585777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.586071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.586253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.586400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.586710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.586840 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587168 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.587999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.588137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.588315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.588447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.588638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.588770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589322 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589800 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.589978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.590108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.590245 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 05:15:44.590374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.590610 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.590945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.591265 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.591587 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.591942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.592269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.592815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.593422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.593826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.594174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.594516 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.594835 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.595151 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.595472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.595805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.596123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.596444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.596762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.597081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.597413 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.597736 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.598056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.598561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.599147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.599744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.600853 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.601319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.601669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.602002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.602358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.602734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.603327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.603860 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.604195 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.604520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.604842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.605164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.605510 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.605854 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.606447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.607047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.607737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.608557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.609152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.610259 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.610259 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.610588 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.610741 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.610949 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.611276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.611612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.611937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.612280 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.612726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.613329 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.613950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.614531 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.615087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.615643 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.616577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.616922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.617240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.617585 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.617902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.618223 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.618539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.618856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.619169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.619482 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.619800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.620111 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.620422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.620735 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.621049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.621359 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.621691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.622006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.622319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.622631 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.622944 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.623251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.623563 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.623900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.624373 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.624699 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.625030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.625351 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.625707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.626031 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.626361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.626692 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.627017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.627335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.627675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.627994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.628315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.628635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.628953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.629270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.629614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.629952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.630387 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.630712 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.631048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.631377 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.631892 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.632247 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.632664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.633955 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.634297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.635420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.636544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.636887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.638031 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.638443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.638722 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.639080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.639431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.639761 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.640107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.640452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.641502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.641502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.641825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.642137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.642467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.642796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.643220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 05:15:44.643388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 05:15:44.654698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO dbcounter [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Registered counter for database nova_api Jun 18 05:15:44.675572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_db.sqlalchemy.engines [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.682509 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writer thread running {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.707584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO dbcounter [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Registered counter for database nova_api Jun 18 05:15:44.729365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_db.sqlalchemy.engines [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.736326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writer thread running {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.741299 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.context [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d1210af-aec7-4375-9a06-dcb0a464d0d2(cell1) {{(pid=117990) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 05:15:44.745475 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:15:44.747008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:15:44.747803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:15:44.749880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:15:44.758549 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO dbcounter [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Registered counter for database nova_cell0 Jun 18 05:15:44.758549 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO dbcounter [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Registered counter for database nova_cell1 Jun 18 05:15:44.766010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_db.sqlalchemy.engines [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.766775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_db.sqlalchemy.engines [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.774801 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writer thread running {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.776154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writer thread running {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.798905 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.context [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d1210af-aec7-4375-9a06-dcb0a464d0d2(cell1) {{(pid=117991) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 05:15:44.803035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:15:44.805790 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:15:44.806593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:15:44.808600 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:15:44.810823 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO dbcounter [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Registered counter for database nova_cell0 Jun 18 05:15:44.814939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO dbcounter [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Registered counter for database nova_cell1 Jun 18 05:15:44.825574 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_db.sqlalchemy.engines [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.828609 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_db.sqlalchemy.engines [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.836398 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writer thread running {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.838653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writer thread running {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.926716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO dbcounter [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Registered counter for database nova_cell0 Jun 18 05:15:44.933941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_db.sqlalchemy.engines [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:44.938523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writer thread running {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:44.990405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO dbcounter [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Registered counter for database nova_cell0 Jun 18 05:15:44.997101 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_db.sqlalchemy.engines [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 05:15:45.002401 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writer thread running {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 05:15:45.261618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: WARNING keystonemiddleware.auth_token [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:15:45.268919 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: WARNING keystonemiddleware.auth_token [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:15:45.328524 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: WARNING keystonemiddleware.auth_token [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:15:45.336597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: WARNING keystonemiddleware.auth_token [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:15:45.609575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: WARNING keystonemiddleware.auth_token [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:15:45.615488 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: WARNING keystonemiddleware.auth_token [None req-d17cf84f-870d-45e2-8943-8efd5b278bee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:15:45.621346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7e4ab09c0 pid: 117990 (default app) Jun 18 05:15:45.681172 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: WARNING keystonemiddleware.auth_token [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 05:15:45.687221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: WARNING keystonemiddleware.auth_token [None req-fcebc1d8-0d1e-49de-9a27-6838ebbbf3c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 05:15:45.692585 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7e4ab09c0 pid: 117991 (default app) Jun 18 05:16:27.536263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:27.537323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:27.540898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:27.540898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:28.698741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d45cf9d7-376e-41bb-9121-cf539632fffb tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Action: 'create', calling method: .version_select at 0x7f7b0369c790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1262792179"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:30.938537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d45cf9d7-376e-41bb-9121-cf539632fffb tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.421762 Jun 18 05:16:30.945925 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1154 bytes} [Sat Jun 18 05:16:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 18 05:16:30.951616 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3c51c091-23dd-430f-8f40-70cac71e4f9c tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035655e0>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:31.057338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3c51c091-23dd-430f-8f40-70cac71e4f9c tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 200 len: 345 microversion: 2.1 time: 0.109821 Jun 18 05:16:31.068642 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:30 2022] GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:31.266219 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-77f36aa1-1be8-4c30-ad78-a2f4f9a0aea0 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b0374f280>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:31.331315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:31.332163 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:31.334034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:31.336840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:16:31.931007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-77f36aa1-1be8-4c30-ad78-a2f4f9a0aea0 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8a4ae59a-7144-4aa4-93cd-5834ec4299c2" status: 200 len: 351 microversion: 2.1 time: 1.097257 Jun 18 05:16:31.932279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:30 2022] GET /compute/v2.1/os-volumes/8a4ae59a-7144-4aa4-93cd-5834ec4299c2 => generated 351 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:32.079965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-190ab561-dc55-44e3-aee9-fe0846e63f14 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b03565700>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:32.505078 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-190ab561-dc55-44e3-aee9-fe0846e63f14 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 200 len: 346 microversion: 2.1 time: 0.431162 Jun 18 05:16:32.505471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:32 2022] GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 346 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:32.519230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-caecb556-0964-4f93-8172-6985f4d5437e tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Action: 'create', calling method: .version_select at 0x7f7b035a6790>, body: {"snapshot": {"volume_id": "933940e5-fa55-44a8-a3bf-202e6ad66421", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2006229299"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:33.645898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-caecb556-0964-4f93-8172-6985f4d5437e tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.131451 Jun 18 05:16:33.648555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 2/5] 10.222.0.23 () {60 vars in 1161 bytes} [Sat Jun 18 05:16:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:33.661795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-97269410-0328-424d-bbfa-23090c88c808 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b03565d30>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:33.755666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-97269410-0328-424d-bbfa-23090c88c808 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 287 microversion: 2.1 time: 0.099543 Jun 18 05:16:33.756243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:33 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:33.767939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-917690a1-f2d6-4ce9-aada-42580f8154e5 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035740d0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:33.908101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-af7c72b7-211c-48a3-a4e3-e286282871a7 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b0357d4c0>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:33.990544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-917690a1-f2d6-4ce9-aada-42580f8154e5 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.227349 Jun 18 05:16:33.997361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Jun 18 05:16:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:34.003387 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f873490d-0d07-4483-92f1-0ef9c8887ad0 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035a6f70>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:34.088356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-af7c72b7-211c-48a3-a4e3-e286282871a7 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e98a3bb6-b964-412a-8021-d10c725d5788" status: 200 len: 351 microversion: 2.1 time: 0.184491 Jun 18 05:16:34.093589 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:33 2022] GET /compute/v2.1/os-volumes/e98a3bb6-b964-412a-8021-d10c725d5788 => generated 351 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:34.137791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f873490d-0d07-4483-92f1-0ef9c8887ad0 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 287 microversion: 2.1 time: 0.139099 Jun 18 05:16:34.138617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 4/9] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:33 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:16:35.151700 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c4067bd2-9d31-4490-991b-18852376c2c4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b03565d30>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:35.401905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c4067bd2-9d31-4490-991b-18852376c2c4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 287 microversion: 2.1 time: 0.251535 Jun 18 05:16:35.401905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 6/10] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:35 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 287 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:36.409563 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-39265aba-7980-4679-9a98-a6ebb1798537 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035a6940>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:36.469903 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-39265aba-7980-4679-9a98-a6ebb1798537 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 287 microversion: 2.1 time: 0.063315 Jun 18 05:16:36.469903 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 5/11] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:36 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:37.481873 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a98cb29a-4942-40aa-a22f-41a2ed0b9a77 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b03565700>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:37.537650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a98cb29a-4942-40aa-a22f-41a2ed0b9a77 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 287 microversion: 2.1 time: 0.061202 Jun 18 05:16:37.539068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:37 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:38.507318 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0961b3a4-0913-48fb-86bc-e7fa905b6f06 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b03574700>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:38.550501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-65b117fa-2d34-4cf7-962b-591276e99561 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b0357d550>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:38.602787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0961b3a4-0913-48fb-86bc-e7fa905b6f06 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a5a69d92-b8f5-4579-80ee-326deaf3a624" status: 200 len: 350 microversion: 2.1 time: 0.097948 Jun 18 05:16:38.602787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:38 2022] GET /compute/v2.1/os-volumes/a5a69d92-b8f5-4579-80ee-326deaf3a624 => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:38.613210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f59e0000-3dfd-4d4c-bf6b-dbd28079d059 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b035a6670>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:38.655356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-65b117fa-2d34-4cf7-962b-591276e99561 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 288 microversion: 2.1 time: 0.108751 Jun 18 05:16:38.661678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 8/14] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:38 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 288 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:38.668313 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f839cf2b-4a44-4ba9-86f3-da391bce3a13 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b0357dc10>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:38.811535 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f59e0000-3dfd-4d4c-bf6b-dbd28079d059 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.201960 Jun 18 05:16:38.819764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Jun 18 05:16:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:38.825710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ef30525e-5887-4cbc-b2fe-8657a9d58442 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b03574a60>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:39.056655 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f839cf2b-4a44-4ba9-86f3-da391bce3a13 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 202 len: 0 microversion: 2.1 time: 0.391936 Jun 18 05:16:39.060055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Jun 18 05:16:38 2022] DELETE /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:16:39.085880 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ef30525e-5887-4cbc-b2fe-8657a9d58442 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.264155 Jun 18 05:16:39.086606 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Jun 18 05:16:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:16:39.093014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-28d9006a-d501-4fbd-b466-478ff69d368e tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035010d0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:39.214861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-28d9006a-d501-4fbd-b466-478ff69d368e tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 200 len: 287 microversion: 2.1 time: 0.127187 Jun 18 05:16:39.215441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:39 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:39.220961 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d8229e78-222b-4a33-94c6-8d89ce75335f tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b035a64c0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:39.266820 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1648183744", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "networks": [{"uuid": "b6326206-c3ac-4e80-bc2a-deaf200d1ad1"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:39.433086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] validate_networks() for [('b6326206-c3ac-4e80-bc2a-deaf200d1ad1', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:16:39.502770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d8229e78-222b-4a33-94c6-8d89ce75335f tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.285642 Jun 18 05:16:39.503364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Jun 18 05:16:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:39.514963 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-917df731-da9a-40fd-8573-de57c6a9b9b8 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b03574dc0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:39.733633 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-917df731-da9a-40fd-8573-de57c6a9b9b8 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.222608 Jun 18 05:16:39.734237 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Jun 18 05:16:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:16:39.746700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-47d29d34-d9be-4729-a346-b3ac693a062d tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b03574700>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:39.902991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-47d29d34-d9be-4729-a346-b3ac693a062d tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.160195 Jun 18 05:16:39.910791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 12/21] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Jun 18 05:16:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:16:39.916733 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-339d603f-8e20-4251-a855-9a52d77e2eac tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b03574b80>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:40.140085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-339d603f-8e20-4251-a855-9a52d77e2eac tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.227776 Jun 18 05:16:40.141403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 13/22] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Jun 18 05:16:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:40.153490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-80b08888-8462-4f9f-b37a-caff2b58720f tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b03ecbc10>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:40.350448 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-80b08888-8462-4f9f-b37a-caff2b58720f tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.200953 Jun 18 05:16:40.351971 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 14/23] 10.222.0.23 () {58 vars in 1187 bytes} [Sat Jun 18 05:16:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:40.362961 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d0a520eb-ced6-4971-b3f2-2782a884582b tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035a63a0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:40.431655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-d0a520eb-ced6-4971-b3f2-2782a884582b tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] HTTP exception thrown: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d0a520eb-ced6-4971-b3f2-2782a884582b tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Request method failure captured: Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e HTTP/1.1 Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-r82CDdNG3KP79Zkl43WMrtU5eRmMXmupQFjZn4_3N0bW7m3cfX3sNHbDxm28HDcPdbxqYfGFb2nt-indoet7nBYwV30Xvh0mLRrvMPOisec4pWoOWimxBDQbaD25JFL4Ph7nEYo7Fa-dwDr8mXHyLSgwKNXO4ww9HTWkvaUlA6_M Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:40.450822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b97df413b0b140a0aceac04617fb59bd"}]}] Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: ef7fdbe955364009a891d2b6cbef1db1 Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '6a651bec-06dc-4bfa-b1a3-3478eacbda2e'} Jun 18 05:16:40.452220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. (HTTP 404) (Request-ID: req-cac9c153-7b6a-458d-a406-39ae94213d43) Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.453043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:40.454139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 18 05:16:40.455225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. Jun 18 05:16:40.456399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:40.465892 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d0a520eb-ced6-4971-b3f2-2782a884582b tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Returning 404 to user: Snapshot 6a651bec-06dc-4bfa-b1a3-3478eacbda2e could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:40.467167 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d0a520eb-ced6-4971-b3f2-2782a884582b tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e" status: 404 len: 111 microversion: 2.1 time: 0.113674 Jun 18 05:16:40.469633 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 15/24] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 05:16:40 2022] GET /compute/v2.1/os-snapshots/6a651bec-06dc-4bfa-b1a3-3478eacbda2e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:16:40.485298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-11318469-8d76-46ed-8452-e8dcac9bf0d0 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] Calling method '.version_select at 0x7f7b035741f0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:40.657321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-11318469-8d76-46ed-8452-e8dcac9bf0d0 tempest-VolumesTestJSON-1211271497 tempest-VolumesTestJSON-1211271497-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.186288 Jun 18 05:16:40.658791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 16/25] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Jun 18 05:16:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:40.678333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-916b2987-719e-42b1-a74b-f23c747ba916 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035744c0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:41.020253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-916b2987-719e-42b1-a74b-f23c747ba916 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 202 len: 0 microversion: 2.1 time: 0.359588 Jun 18 05:16:41.023846 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 17/26] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:16:40 2022] DELETE /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:16:41.032557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c63848e8-b273-4f3c-9e95-6dd3e84bf722 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b035011f0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:41.143742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c63848e8-b273-4f3c-9e95-6dd3e84bf722 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 200 len: 345 microversion: 2.1 time: 0.116898 Jun 18 05:16:41.145020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 18/27] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:41 2022] GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:16:41.902666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:16:41.903207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:16:41.903624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:16:41.904041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:16:41.904506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:16:41.906760 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fa5e6d3c-ce91-4613-9fd7-25faffc8f8b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: .version_select at 0x7f7b03501700>, body: {"keypair": {"name": "tempest-keypair-788758118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO1Y5prdq1bUo+upY0aH6kvB5UnZ3Fp4tICMeZuZW93BSUshbNN+Q2cXhhXZ7toBL3r6hpnU3sHpSHyspF3aF0h+ZOJNte1wJzmxMwMLE8mYqzSt+xfB63ktzuB3MbKDA=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:41.938973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:41.947094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:41.948467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:41.949187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:42.048296 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Getting quotas for project 0b73d42a085a45bfb3ccced90b190a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:16:42.052564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-fa5e6d3c-ce91-4613-9fd7-25faffc8f8b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:16:42.068474 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Getting quotas for user 79f8817a70b844d7ac49543d74d0e38b and project 0b73d42a085a45bfb3ccced90b190a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:16:42.073221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-fa5e6d3c-ce91-4613-9fd7-25faffc8f8b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for user d2c8f964ee6a49cda501ed28a9432c8e and project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:16:42.099612 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:16:42.107886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:16:42.270229 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fa5e6d3c-ce91-4613-9fd7-25faffc8f8b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.675529 Jun 18 05:16:42.271463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 19/28] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:16:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:16:42.287205 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-20ffb287-834d-4961-a239-de21aedca1a4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b034b3dc0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:42.334979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b1e300e1-aff6-49a2-91de-27e2df6494d9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.268183 Jun 18 05:16:42.344996 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 10/29] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:16:42.374361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-20ffb287-834d-4961-a239-de21aedca1a4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] HTTP exception thrown: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-20ffb287-834d-4961-a239-de21aedca1a4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Request method failure captured: Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 HTTP/1.1 Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-r82CDdNG3KP79Zkl43WMrtU5eRmMXmupQFjZn4_3N0bW7m3cfX3sNHbDxm28HDcPdbxqYfGFb2nt-indoet7nBYwV30Xvh0mLRrvMPOisec4pWoOWimxBDQbaD25JFL4Ph7nEYo7Fa-dwDr8mXHyLSgwKNXO4ww9HTWkvaUlA6_M Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:42.379209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b97df413b0b140a0aceac04617fb59bd"}]}] Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: ef7fdbe955364009a891d2b6cbef1db1 Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '933940e5-fa55-44a8-a3bf-202e6ad66421'} Jun 18 05:16:42.386053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. (HTTP 404) (Request-ID: req-e53333e2-294e-4556-bd9a-159386100356) Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.387023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:42.387884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 05:16:42.388745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.390612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-20ffb287-834d-4961-a239-de21aedca1a4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Returning 404 to user: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:42.391829 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2d0d14d6-06cc-4747-ac4a-7584fd045f9d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:42.391953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-20ffb287-834d-4961-a239-de21aedca1a4 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 404 len: 109 microversion: 2.1 time: 0.109042 Jun 18 05:16:42.391953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 20/30] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:42 2022] GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:16:42.398591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2d0d14d6-06cc-4747-ac4a-7584fd045f9d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:42.401928 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-91b3ed09-8188-4d08-8651-b83f31c71a6a tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b03574c10>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:42.467311 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-91b3ed09-8188-4d08-8651-b83f31c71a6a tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] HTTP exception thrown: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-91b3ed09-8188-4d08-8651-b83f31c71a6a tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Request method failure captured: Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 HTTP/1.1 Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-r82CDdNG3KP79Zkl43WMrtU5eRmMXmupQFjZn4_3N0bW7m3cfX3sNHbDxm28HDcPdbxqYfGFb2nt-indoet7nBYwV30Xvh0mLRrvMPOisec4pWoOWimxBDQbaD25JFL4Ph7nEYo7Fa-dwDr8mXHyLSgwKNXO4ww9HTWkvaUlA6_M Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:42.470474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b97df413b0b140a0aceac04617fb59bd"}]}] Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: ef7fdbe955364009a891d2b6cbef1db1 Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '933940e5-fa55-44a8-a3bf-202e6ad66421'} Jun 18 05:16:42.471495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. (HTTP 404) (Request-ID: req-090d1537-5604-4b4d-8bcb-8c5a757d0253) Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.472107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 05:16:42.473063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 05:16:42.474282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.475497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-91b3ed09-8188-4d08-8651-b83f31c71a6a tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Returning 404 to user: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:42.477171 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-91b3ed09-8188-4d08-8651-b83f31c71a6a tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 404 len: 109 microversion: 2.1 time: 0.083942 Jun 18 05:16:42.485543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 21/31] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:16:42 2022] DELETE /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:16:42.491541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cfa965bf-37d5-4381-92e9-5ba8f909cc78 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Calling method '.version_select at 0x7f7b034dc940>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-cfa965bf-37d5-4381-92e9-5ba8f909cc78 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] HTTP exception thrown: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cfa965bf-37d5-4381-92e9-5ba8f909cc78 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Request method failure captured: Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 HTTP/1.1 Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-r82CDdNG3KP79Zkl43WMrtU5eRmMXmupQFjZn4_3N0bW7m3cfX3sNHbDxm28HDcPdbxqYfGFb2nt-indoet7nBYwV30Xvh0mLRrvMPOisec4pWoOWimxBDQbaD25JFL4Ph7nEYo7Fa-dwDr8mXHyLSgwKNXO4ww9HTWkvaUlA6_M Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:42.603326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b97df413b0b140a0aceac04617fb59bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b97df413b0b140a0aceac04617fb59bd"}]}] Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: b97df413b0b140a0aceac04617fb59bd Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437843747 Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: ef7fdbe955364009a891d2b6cbef1db1 Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437843747-project Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '933940e5-fa55-44a8-a3bf-202e6ad66421'} Jun 18 05:16:42.604797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. (HTTP 404) (Request-ID: req-768d8524-8cc7-42f9-b774-77bd147a96ca) Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.605546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:42.606491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 05:16:42.607407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cfa965bf-37d5-4381-92e9-5ba8f909cc78 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] Returning 404 to user: Volume 933940e5-fa55-44a8-a3bf-202e6ad66421 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cfa965bf-37d5-4381-92e9-5ba8f909cc78 tempest-VolumesSnapshotsTestJSON-437843747 tempest-VolumesSnapshotsTestJSON-437843747-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421" status: 404 len: 109 microversion: 2.1 time: 0.116906 Jun 18 05:16:42.610586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 22/32] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:42 2022] GET /compute/v2.1/os-volumes/933940e5-fa55-44a8-a3bf-202e6ad66421 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:16:42.817802 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2d0d14d6-06cc-4747-ac4a-7584fd045f9d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:42.872289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2d0d14d6-06cc-4747-ac4a-7584fd045f9d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1215 microversion: 2.1 time: 0.522969 Jun 18 05:16:42.883553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 11/33] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:42 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1215 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:43.891242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-88413914-bac0-443c-b358-422fcfc400ec tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:43.891928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-88413914-bac0-443c-b358-422fcfc400ec tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:44.043219 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-88413914-bac0-443c-b358-422fcfc400ec tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:44.055197 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-88413914-bac0-443c-b358-422fcfc400ec tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1215 microversion: 2.1 time: 0.169485 Jun 18 05:16:44.061777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 12/34] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:43 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:44.218912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3f21b101-ff88-4e02-acad-c4062cc81654 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'create', calling method: .version_select at 0x7f7b034b3ee0>, body: {"keypair": {"name": "tempest-keypair-2093710094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSZ92yJVJRpzsP6aT3EBy5V2lBHnSbQTYoSuC+NTs/Smpkk2wkUfgSmJ4+xCbM5TQ3GljNbrJR+hiOQYpIGFIF5yen7kWPpRTskUdVBy8vd1iPc91JaxepViFoQHTLCg=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:44.251947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-3f21b101-ff88-4e02-acad-c4062cc81654 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for project 758883a5aea04c85ad65bb6970bdb098. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:16:44.264302 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-3f21b101-ff88-4e02-acad-c4062cc81654 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for user e0f3999a062e45748878a3204e3ea456 and project 758883a5aea04c85ad65bb6970bdb098. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:16:44.430320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3f21b101-ff88-4e02-acad-c4062cc81654 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.420667 Jun 18 05:16:44.431493 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 23/35] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Jun 18 05:16:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 05:16:45.077795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d37c471e-8fe4-46ad-b2e1-582b68d04881 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:45.078950 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d37c471e-8fe4-46ad-b2e1-582b68d04881 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:45.205086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d37c471e-8fe4-46ad-b2e1-582b68d04881 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:45.219466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d37c471e-8fe4-46ad-b2e1-582b68d04881 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1215 microversion: 2.1 time: 0.145869 Jun 18 05:16:45.221460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 13/36] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:45 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:46.241825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:46.242726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:46.270336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:46.271211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:46.275995 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:46.277138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:46.655229 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:46.699017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4369a742-c85d-4bb5-a979-3480cec60975 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1211 microversion: 2.1 time: 0.464166 Jun 18 05:16:46.706546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 24/37] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:46 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1211 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:47.729716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:47.745345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:47.781363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:47.784256 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:47.790452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:47.792491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:48.040967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-300882054", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22d8eb11-0b66-4ea6-b4d2-3deab0a32f40"}], "security_groups": [{"name": "tempest-securitygroup--1756447010"}], "key_name": "tempest-keypair-788758118", "user_data": "}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:48.240085 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:48.276935 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1785b228-13b4-4639-b58e-13f3550155a4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1275 microversion: 2.1 time: 0.557612 Jun 18 05:16:48.280388 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 14/38] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:47 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1275 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:48.524586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] validate_networks() for [('22d8eb11-0b66-4ea6-b4d2-3deab0a32f40', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:16:49.303114 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:49.304649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:49.312482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:49.313252 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:49.314467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:49.315072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:49.549361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:49.559476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ecbfb028-bf53-4a51-b326-5b1db76d3203 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1273 microversion: 2.1 time: 0.260607 Jun 18 05:16:49.562963 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 15/39] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:49 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:49.577638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-475944929", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7ef077f-c52c-4f70-b85e-e8892706babc"}], "security_groups": [{"name": "tempest-securitygroup--1825929109"}], "key_name": "tempest-keypair-2093710094", "user_data": "}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:49.768365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] validate_networks() for [('f7ef077f-c52c-4f70-b85e-e8892706babc', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:16:50.924949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:16:50.925745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:16:50.926185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:16:50.926861 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:16:50.928033 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:16:50.940088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:50.941517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:50.943309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:50.945159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:50.970802 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for project 758883a5aea04c85ad65bb6970bdb098. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:16:50.982948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for user e0f3999a062e45748878a3204e3ea456 and project 758883a5aea04c85ad65bb6970bdb098. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:16:51.002401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:16:51.007981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:16:51.178824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-662a9750-1c2c-4a02-9803-677ef9b7fbd0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.607367 Jun 18 05:16:51.178824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 16/40] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Jun 18 05:16:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 05:16:51.205171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:51.207150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:51.227423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:51.228713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:51.229712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:51.230002 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:51.417527 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:16:51.418010 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:16:51.418239 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:16:51.418842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:16:51.419246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:16:51.435376 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:51.435831 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:51.436643 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:51.437073 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:51.516649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:16:51.528404 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for user d2c8f964ee6a49cda501ed28a9432c8e and project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:16:51.560362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:16:51.563480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:16:51.579195 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:51.591122 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-39e079fb-3244-455c-8c73-2359549948cb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.416016 Jun 18 05:16:51.591909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 17/41] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:51 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:51.597977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ec3130c9-e28a-45e0-840b-27b071166eb9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:51.599010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ec3130c9-e28a-45e0-840b-27b071166eb9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:51.792595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8fa340d4-afe6-41aa-9272-b70d9f166296 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.757858 Jun 18 05:16:51.794480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 25/42] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:16:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 05:16:51.809081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-35591cd1-a131-419e-bfe6-7c1134390a80 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:51.810109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-35591cd1-a131-419e-bfe6-7c1134390a80 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:51.834197 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ec3130c9-e28a-45e0-840b-27b071166eb9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:51.853070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ec3130c9-e28a-45e0-840b-27b071166eb9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:51.903384 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ec3130c9-e28a-45e0-840b-27b071166eb9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:51.904573 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ec3130c9-e28a-45e0-840b-27b071166eb9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1281 microversion: 2.20 time: 0.311490 Jun 18 05:16:51.913567 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 18/43] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:51 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1281 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:16:52.138919 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-35591cd1-a131-419e-bfe6-7c1134390a80 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:52.176696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-35591cd1-a131-419e-bfe6-7c1134390a80 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1236 microversion: 2.1 time: 0.364935 Jun 18 05:16:52.176696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 26/44] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:51 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1236 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:52.608738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:52.609152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:52.624505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:52.625133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:52.626099 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:52.626680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:53.072970 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:53.105442 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d85f46ec-c4d4-45d0-9433-a3c6c1f03138 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.499334 Jun 18 05:16:53.107479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 19/45] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:52 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:53.122667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cdcec524-6d90-4a7c-8a9b-165bedd0b107 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:53.128868 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cdcec524-6d90-4a7c-8a9b-165bedd0b107 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:53.284383 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cdcec524-6d90-4a7c-8a9b-165bedd0b107 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:53.305580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cdcec524-6d90-4a7c-8a9b-165bedd0b107 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:53.320647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cdcec524-6d90-4a7c-8a9b-165bedd0b107 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:53.326074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cdcec524-6d90-4a7c-8a9b-165bedd0b107 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1281 microversion: 2.20 time: 0.216535 Jun 18 05:16:53.335726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 20/46] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:53 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:16:53.335726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1f0d7200-3e62-48fc-a57b-306159b25cdc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:53.335726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-1f0d7200-3e62-48fc-a57b-306159b25cdc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:53.401448 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1f0d7200-3e62-48fc-a57b-306159b25cdc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:53.416122 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1f0d7200-3e62-48fc-a57b-306159b25cdc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1236 microversion: 2.1 time: 0.085712 Jun 18 05:16:53.417614 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 21/47] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:53 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:53.519735 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-32f1711f-0288-4c50-ac33-8aaaad3aed34 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Action: 'create', calling method: .version_select at 0x7f7b02ad4d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1498236853", "metadata": {"Type": "work"}}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-32f1711f-0288-4c50-ac33-8aaaad3aed34 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Request method failure captured: Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 122 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV_ECBo8BtNK_jMVAMZDji3JDOudOgK0OFuogKRPbbDt07Id47pMNdfLMwwtbuZpCqnz_VNaWkBq97CHpxg5eBYniSZasAPVrx3KKKO2phy6Q1_fjSBhoml4Egaq2u2c7sW_dyPou3xqq52dCtedlccjk5mvdmZZh3y_h0btr2_KtH8 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:53.549841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/62c17eddb9ae4b6698b3706b1a3c8d01"}]}] Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 760e1aeeff814c2b9aa9023604c3347f Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1498236853", "metadata": {"Type": "work"}}} Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:53.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1498236853', 'metadata': {'Type': 'work'}}}} Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise error Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi '#$%' Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:53.551787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 05:16:53.552900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 05:16:53.553896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 05:16:53.553896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.553896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-32f1711f-0288-4c50-ac33-8aaaad3aed34 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:53.553896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-32f1711f-0288-4c50-ac33-8aaaad3aed34 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.822604 Jun 18 05:16:53.563322 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 27/48] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 05:16:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 836 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 05:16:53.570258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a8d522f0-6821-48dc-8fe6-053c5239276b tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Action: 'create', calling method: .version_select at 0x7f7b02c2a310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1254281533", "metadata": {"Type": "work"}}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a8d522f0-6821-48dc-8fe6-053c5239276b tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Request method failure captured: Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 120 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV_ECBo8BtNK_jMVAMZDji3JDOudOgK0OFuogKRPbbDt07Id47pMNdfLMwwtbuZpCqnz_VNaWkBq97CHpxg5eBYniSZasAPVrx3KKKO2phy6Q1_fjSBhoml4Egaq2u2c7sW_dyPou3xqq52dCtedlccjk5mvdmZZh3y_h0btr2_KtH8 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:16:53.577146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/62c17eddb9ae4b6698b3706b1a3c8d01"}]}] Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 760e1aeeff814c2b9aa9023604c3347f Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1254281533", "metadata": {"Type": "work"}}} Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: Jun 18 05:16:53.578440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1254281533', 'metadata': {'Type': 'work'}}}} Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise error Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi '0' Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:53.579092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 05:16:53.580209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 05:16:53.581954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 05:16:53.581954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.584365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a8d522f0-6821-48dc-8fe6-053c5239276b tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:53.586134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a8d522f0-6821-48dc-8fe6-053c5239276b tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025693 Jun 18 05:16:53.587097 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 22/49] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 05:16:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:16:53.599011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bc951e54-aa97-4852-8f08-16d702e2596d tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Action: 'create', calling method: .version_select at 0x7f7b01a991f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-328057894", "metadata": {"Type": "work"}}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bc951e54-aa97-4852-8f08-16d702e2596d tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Request method failure captured: Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 118 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV_ECBo8BtNK_jMVAMZDji3JDOudOgK0OFuogKRPbbDt07Id47pMNdfLMwwtbuZpCqnz_VNaWkBq97CHpxg5eBYniSZasAPVrx3KKKO2phy6Q1_fjSBhoml4Egaq2u2c7sW_dyPou3xqq52dCtedlccjk5mvdmZZh3y_h0btr2_KtH8 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:53.604641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/62c17eddb9ae4b6698b3706b1a3c8d01"}]}] Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 760e1aeeff814c2b9aa9023604c3347f Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-328057894", "metadata": {"Type": "work"}}} Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:53.605834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-328057894', 'metadata': {'Type': 'work'}}}} Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise error Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi '' Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:53.606543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 05:16:53.607648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 05:16:53.608629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 05:16:53.608629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:53.608629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bc951e54-aa97-4852-8f08-16d702e2596d tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:53.608629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bc951e54-aa97-4852-8f08-16d702e2596d tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013709 Jun 18 05:16:53.612296 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 28/50] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 05:16:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:16:53.620242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962e57bf-53a5-47ec-a8c5-5fb711855d16 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Calling method '.version_select at 0x7f7b02302a60>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:54.000611 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-962e57bf-53a5-47ec-a8c5-5fb711855d16 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] HTTP exception thrown: Volume tempest-invalid-1931136940 could not be found. Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962e57bf-53a5-47ec-a8c5-5fb711855d16 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Request method failure captured: Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1931136940 HTTP/1.1 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV_ECBo8BtNK_jMVAMZDji3JDOudOgK0OFuogKRPbbDt07Id47pMNdfLMwwtbuZpCqnz_VNaWkBq97CHpxg5eBYniSZasAPVrx3KKKO2phy6Q1_fjSBhoml4Egaq2u2c7sW_dyPou3xqq52dCtedlccjk5mvdmZZh3y_h0btr2_KtH8 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:16:54.005309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/62c17eddb9ae4b6698b3706b1a3c8d01"}]}] Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 760e1aeeff814c2b9aa9023604c3347f Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Volume tempest-invalid-1931136940 could not be found. Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'tempest-invalid-1931136940'} Jun 18 05:16:54.007146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1931136940 could not be found. (HTTP 404) (Request-ID: req-5f839521-647d-4273-9c16-8ee7d3efeec0) Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.007808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 05:16:54.008789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1931136940 could not be found. Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:54.011962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1931136940 could not be found. Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1931136940 could not be found. Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962e57bf-53a5-47ec-a8c5-5fb711855d16 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Returning 404 to user: Volume tempest-invalid-1931136940 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-962e57bf-53a5-47ec-a8c5-5fb711855d16 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1931136940" status: 404 len: 99 microversion: 2.1 time: 0.392429 Jun 18 05:16:54.019702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 23/51] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 05:16:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1931136940 => generated 99 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 05:16:54.030468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-dbee40bf-22f6-44c4-acd3-d7998a9df6c3 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011368 Jun 18 05:16:54.031332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 29/52] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Jun 18 05:16:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 05:16:54.044414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5fb02194-06a4-4b80-a2b9-ca82dbe03fe0 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005090 Jun 18 05:16:54.044934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 24/53] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Jun 18 05:16:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 05:16:54.059083 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c0d9aff6-e186-438c-988d-fc527dd7fd51 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Calling method '.version_select at 0x7f7b02b59430>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:54.126175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:54.126175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:54.160782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:54.165871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:54.166879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:54.172867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:54.248979 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-c0d9aff6-e186-438c-988d-fc527dd7fd51 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] HTTP exception thrown: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c0d9aff6-e186-438c-988d-fc527dd7fd51 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Request method failure captured: Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/os-volumes/567331f9-de74-4a96-9a63-9959fd9b73f2 HTTP/1.1 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV_ECBo8BtNK_jMVAMZDji3JDOudOgK0OFuogKRPbbDt07Id47pMNdfLMwwtbuZpCqnz_VNaWkBq97CHpxg5eBYniSZasAPVrx3KKKO2phy6Q1_fjSBhoml4Egaq2u2c7sW_dyPou3xqq52dCtedlccjk5mvdmZZh3y_h0btr2_KtH8 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:54.253989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/62c17eddb9ae4b6698b3706b1a3c8d01"}]}] Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 760e1aeeff814c2b9aa9023604c3347f Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '567331f9-de74-4a96-9a63-9959fd9b73f2'} Jun 18 05:16:54.255150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. (HTTP 404) (Request-ID: req-33f7b0bf-dc7e-4666-9536-cd1cbbb78038) Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.255912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 05:16:54.257617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 05:16:54.258725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c0d9aff6-e186-438c-988d-fc527dd7fd51 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Returning 404 to user: Volume 567331f9-de74-4a96-9a63-9959fd9b73f2 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c0d9aff6-e186-438c-988d-fc527dd7fd51 tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/567331f9-de74-4a96-9a63-9959fd9b73f2" status: 404 len: 109 microversion: 2.1 time: 0.205593 Jun 18 05:16:54.259775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 30/54] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:16:54 2022] DELETE /compute/v2.1/os-volumes/567331f9-de74-4a96-9a63-9959fd9b73f2 => generated 109 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:16:54.301015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-40e4abb8-1e0e-44c9-a4c5-3b62115ab3fc tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Calling method '.version_select at 0x7f7b01a99d30>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:54.406217 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-40e4abb8-1e0e-44c9-a4c5-3b62115ab3fc tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] HTTP exception thrown: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-40e4abb8-1e0e-44c9-a4c5-3b62115ab3fc tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Request method failure captured: Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/os-volumes/a454fda7-8840-456c-8e2d-82ea36ac0ca3 HTTP/1.1 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV_ECBo8BtNK_jMVAMZDji3JDOudOgK0OFuogKRPbbDt07Id47pMNdfLMwwtbuZpCqnz_VNaWkBq97CHpxg5eBYniSZasAPVrx3KKKO2phy6Q1_fjSBhoml4Egaq2u2c7sW_dyPou3xqq52dCtedlccjk5mvdmZZh3y_h0btr2_KtH8 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:16:54.408425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_62c17eddb9ae4b6698b3706b1a3c8d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/62c17eddb9ae4b6698b3706b1a3c8d01"}]}] Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 62c17eddb9ae4b6698b3706b1a3c8d01 Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesNegativeTest-350886117 Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 760e1aeeff814c2b9aa9023604c3347f Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesNegativeTest-350886117-project Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'a454fda7-8840-456c-8e2d-82ea36ac0ca3'} Jun 18 05:16:54.409898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. (HTTP 404) (Request-ID: req-62e4422a-9b55-4218-8e16-81fed291e503) Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.410696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:16:54.411819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 05:16:54.412811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-40e4abb8-1e0e-44c9-a4c5-3b62115ab3fc tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] Returning 404 to user: Volume a454fda7-8840-456c-8e2d-82ea36ac0ca3 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:16:54.413800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-40e4abb8-1e0e-44c9-a4c5-3b62115ab3fc tempest-VolumesNegativeTest-350886117 tempest-VolumesNegativeTest-350886117-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a454fda7-8840-456c-8e2d-82ea36ac0ca3" status: 404 len: 109 microversion: 2.1 time: 0.143421 Jun 18 05:16:54.423138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 31/55] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:16:54 2022] GET /compute/v2.1/os-volumes/a454fda7-8840-456c-8e2d-82ea36ac0ca3 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:16:54.452533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:54.454587 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:54.472519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:54.473278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:54.475309 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:54.475988 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:54.840237 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:54.848890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6d2f4b32-c2db-4a9a-98e5-5d5e33910ba6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.727770 Jun 18 05:16:54.849501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 25/56] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:54 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:54.869533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:54.870156 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:54.884016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:54.884871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:54.887160 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:54.889261 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:54.926357 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:54.946970 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:54.948953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:54.950245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-be0e9390-3877-4b68-9af5-fc20cad4340a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1285 microversion: 2.20 time: 0.525726 Jun 18 05:16:54.951080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 32/57] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:54 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1285 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:16:55.062100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:55.072458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cabe4cc5-caa5-49d4-ab28-89e96f3239e1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1240 microversion: 2.1 time: 0.221903 Jun 18 05:16:55.074297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 26/58] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:54 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1240 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:55.632925 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-957bfb7e-85ee-4707-9078-33dde8867e40 req-85eb5277-0d8e-4050-8dc5-55dc38d89db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f277a3d-57bc-4fce-82d5-b163cbbcade0", "tag": "b7964cda-123c-4433-9d83-8d7e89fdef4a"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:16:55.655838 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-957bfb7e-85ee-4707-9078-33dde8867e40 req-85eb5277-0d8e-4050-8dc5-55dc38d89db7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.655838 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-957bfb7e-85ee-4707-9078-33dde8867e40 req-85eb5277-0d8e-4050-8dc5-55dc38d89db7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:55.733140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-957bfb7e-85ee-4707-9078-33dde8867e40 req-85eb5277-0d8e-4050-8dc5-55dc38d89db7 service nova] Creating event network-changed:b7964cda-123c-4433-9d83-8d7e89fdef4a for instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 on hv-cinder-83699 Jun 18 05:16:55.737273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-957bfb7e-85ee-4707-9078-33dde8867e40 req-85eb5277-0d8e-4050-8dc5-55dc38d89db7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 05:16:55.743281 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.743838 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:55.744688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.745122 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:55.759413 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.compute.rpcapi [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 18 05:16:55.760129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] Releasing lock "compute-rpcapi-router" {{(pid=117991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 05:16:55.807726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cb87b290-da63-4165-9e71-e1cb2e7dab63 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.841638 Jun 18 05:16:55.821665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 33/59] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:16:55.866734 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:55.867421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:55.887331 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.887993 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:55.888902 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.896246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:55.970908 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:55.971614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:55.982355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.989104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:55.989104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:55.989104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:56.089070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:56.111542 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:56.115642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:56.115642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-790f9e2a-a26c-4f80-aa84-c1bc8567acfe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1333 microversion: 2.20 time: 0.148422 Jun 18 05:16:56.116614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 34/60] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:55 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:16:56.131284 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:56.133657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:56.142688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:56.153587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0fdb45d8-4db0-4e0e-8d7f-8c6d234838aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.291340 Jun 18 05:16:56.158523 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:56.158523 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:56.169011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:56.170814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:56.174402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 27/61] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:55 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:56.354427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:56.363379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d486aa45-0b93-4cd0-922b-5db23f04f606 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1288 microversion: 2.1 time: 0.245465 Jun 18 05:16:56.365953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 35/62] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:56 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1288 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:57.139641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:57.140628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:57.152306 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:57.152950 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:57.157910 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:57.158566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:57.174995 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:57.175838 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:57.183341 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:57.183471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:57.184201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:57.184638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:57.252934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:57.262988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:57.264793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:57.266145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-947c2140-e893-46d7-ab30-2cdba7a745de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1341 microversion: 2.20 time: 0.131140 Jun 18 05:16:57.266716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 28/63] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:57 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1341 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:16:57.386770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:57.387673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:57.410813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:57.410813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:57.410813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:57.416604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:57.567392 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:57.590049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d9e572b3-2555-49b0-b1d2-b3bf405e18c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.418667 Jun 18 05:16:57.591101 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 36/64] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:57 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:57.671587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:57.689594 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-92b31c1c-8ab6-4e21-9b4a-7c4c8aab7925 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1288 microversion: 2.1 time: 0.309551 Jun 18 05:16:57.693467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 29/65] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:57 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1288 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:58.287474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:58.288962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:58.307323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:58.315568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:58.315568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:58.315568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:58.417253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:58.453208 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:58.457824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:58.461589 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d7fcaaf0-a364-4568-a121-277bf4d5ecaa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1341 microversion: 2.20 time: 0.178228 Jun 18 05:16:58.476460 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 37/66] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:58 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:16:58.608322 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:58.608944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:58.629123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:58.629123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:58.629123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:58.630115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:58.718132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:58.719064 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:58.729173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:58.734090 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:58.737622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:58.739976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:58.970321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:58.985925 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8e8738c9-c254-483e-a54e-05032d14cf23 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1296 microversion: 2.1 time: 0.279194 Jun 18 05:16:58.995420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 38/67] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:58 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1296 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:59.005711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:59.016371 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e95de38c-7b6e-4994-a48c-58cb5dbcbb25 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.412694 Jun 18 05:16:59.016953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 30/68] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:16:58 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:16:59.485974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:16:59.489204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:16:59.514235 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:59.514759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:59.515599 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:16:59.516063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:16:59.676358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:59.704911 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:59.717721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:16:59.721784 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bcff35d9-2b8c-4923-ba68-e77307a8a216 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1339 microversion: 2.20 time: 0.240687 Jun 18 05:16:59.726123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 39/69] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:16:59 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:00.015380 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:00.016952 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:00.024697 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:00.025522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:00.026617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:00.027263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:00.048649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:00.050797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:00.089638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:00.098595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:00.098595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:00.098595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:00.156281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:00.162124 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bdebbbe8-c2e2-48c1-9db6-43720d964d93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1294 microversion: 2.1 time: 0.150331 Jun 18 05:17:00.174482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 31/70] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:00 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:00.346753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:00.361852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-45a921c2-40a3-435e-b410-3c4be0ec822f tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.325397 Jun 18 05:17:00.363742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 40/71] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:00 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:00.748127 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:00.748742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:00.759719 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:00.763050 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:00.763050 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:00.763050 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:00.959579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=4 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:01.066671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:01.079763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:01.080725 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:01.081904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-7ea298a3-7d3d-4871-a400-daa7232cccc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.339873 Jun 18 05:17:01.092591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 32/72] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:00 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:01.180446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:01.181066 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:01.195262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:01.195761 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:01.196420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:01.196856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:01.380095 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:01.380892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:01.388524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:01.391494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:01.392571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:01.394769 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:01.451999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:01.462450 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-adadc9e4-a61e-41c3-bb2a-35f71faf18b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.286053 Jun 18 05:17:01.464490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 41/73] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:01 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:01.633104 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:01.643009 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f56f2b2d-284e-42da-a857-99d02c77f92b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.266671 Jun 18 05:17:01.643585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 33/74] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:01 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:02.099883 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:02.101190 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:02.107130 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:02.107565 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:02.108318 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:02.108745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:02.168394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=16 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:02.258256 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:02.266351 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:02.267851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:02.269481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0f3b375c-c03e-4914-8987-0f720190ee26 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.172915 Jun 18 05:17:02.274445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 42/75] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:02 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:02.484631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:02.484631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:02.490900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:02.493122 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:02.494372 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:02.495391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:02.660136 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:02.660901 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:02.662909 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=5 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:02.673812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:02.674268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:02.675036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:02.675471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:02.676651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:02.698123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-87451e84-027a-4c51-9c63-aa8c49c8a66d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.219121 Jun 18 05:17:02.708857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 34/76] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:02 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:02.857647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:02.865011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d37e3614-1b31-4f2e-a28b-ceff8c2f4035 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.208992 Jun 18 05:17:02.865968 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 43/77] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:02 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:17:03.288249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:03.294178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:03.300663 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:03.301063 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:03.304671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:03.304671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:03.406217 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=24 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:03.566666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:03.581051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:03.591012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:03.593892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-17eefe17-35f7-4c49-b971-5e58083b258c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.309893 Jun 18 05:17:03.595177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 35/78] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:03 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:03.718828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:03.720178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:03.742257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:03.742992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:03.745008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:03.745742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:03.885327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:03.886355 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:03.896205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:03.896882 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:03.899322 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:03.900022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:04.016363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:04.037567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-13cc1705-7bd6-4c99-9069-795d5e250a44 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.322771 Jun 18 05:17:04.050077 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 44/79] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:03 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:04.618320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:04.619400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:04.634514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:04.635290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:04.636541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:04.637665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:04.671837 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:04.675584 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:04.685622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b78812d4-374c-4de8-bc06-c2f4f0d20273 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.803544 Jun 18 05:17:04.686849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 36/80] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:03 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:17:04.810529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:04.814266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:04.815839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:04.817036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-47b578fd-ded6-45d1-aea1-cce4eb074ccb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.204072 Jun 18 05:17:04.817794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 45/81] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:04 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:17:05.058871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:05.059480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:05.067977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:05.067977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:05.067977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:05.067977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:05.368952 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:05.382899 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dfe8e4e6-5cb2-4b7e-91b2-8975e33608f9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.330632 Jun 18 05:17:05.385139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 37/82] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:05 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:05.704801 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:05.705691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:05.717298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:05.717298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:05.717298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:05.717298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:05.765477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:05.836284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:05.836972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:05.855458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:05.857563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:05.866360 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:05.866360 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:06.015843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:06.026825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c832d6ff-f8df-498d-a140-6612db36b99a tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.325777 Jun 18 05:17:06.028708 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 46/83] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:05 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:06.236519 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:06.252089 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:06.253658 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:06.255112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b8ef3766-f881-4c9e-b0c0-8313aae76cef tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.423912 Jun 18 05:17:06.265694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 38/84] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:05 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:06.401981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:06.402837 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:06.417171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:06.418142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:06.438011 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:06.440083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:06.550410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-a0262125-2bc1-4b90-bd47-bddfb6a5d58c req-2cf704f0-bd3b-4285-8ccf-a83633a49d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:06.569711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-a0262125-2bc1-4b90-bd47-bddfb6a5d58c req-2cf704f0-bd3b-4285-8ccf-a83633a49d72 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:06.570401 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-a0262125-2bc1-4b90-bd47-bddfb6a5d58c req-2cf704f0-bd3b-4285-8ccf-a83633a49d72 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:06.601140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-a0262125-2bc1-4b90-bd47-bddfb6a5d58c req-2cf704f0-bd3b-4285-8ccf-a83633a49d72 service nova] Creating event network-changed:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:17:06.612206 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-a0262125-2bc1-4b90-bd47-bddfb6a5d58c req-2cf704f0-bd3b-4285-8ccf-a83633a49d72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227638 Jun 18 05:17:06.615024 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 47/85] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:06.981423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:06.982358 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fb1e4e04-b935-47d4-bf22-db93a9a4a310 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.585343 Jun 18 05:17:06.982645 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 39/86] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:06 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:07.046042 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:07.046864 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:07.065504 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:07.065976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:07.066761 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:07.067203 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:07.090483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:07.277677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:07.278522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:07.290900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:07.295472 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:07.296400 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:07.298361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:07.447124 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:07.458653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-366e4bda-b987-4d82-826e-1088a729bae2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.417482 Jun 18 05:17:07.460360 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 48/87] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:07 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:07.677647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:07.686025 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:07.688184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:07.689502 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3561b610-3166-47f8-a16c-e5100a894826 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.418427 Jun 18 05:17:07.690382 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 40/88] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:07 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:07.999118 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:07.999733 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:08.007144 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.008564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.010855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.010855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.207787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:08.217260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-96cde6dc-1735-4e56-bbec-dd422a0d563c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.222229 Jun 18 05:17:08.217930 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 49/89] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:07 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:08.478857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:08.479849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:08.482967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:08.486446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.486978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.487735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.488159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.626357 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:08.634826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-837cfe62-b8dd-4b92-9b64-a953db2805c4 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.162085 Jun 18 05:17:08.635587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 41/90] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:08 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:08.671413 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-a47d5f6c-0e24-44ca-ab6b-3069e143535f req-c32949ee-222d-44ca-961f-fe9e827591c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240d96c6-c2da-4ee1-8fd9-554944f65d95", "tag": "376a2e8d-64a9-45d4-8092-b0e803666ea7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:08.681141 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-a47d5f6c-0e24-44ca-ab6b-3069e143535f req-c32949ee-222d-44ca-961f-fe9e827591c9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.687782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-a47d5f6c-0e24-44ca-ab6b-3069e143535f req-c32949ee-222d-44ca-961f-fe9e827591c9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.698252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-a47d5f6c-0e24-44ca-ab6b-3069e143535f req-c32949ee-222d-44ca-961f-fe9e827591c9 service nova] Creating event network-changed:376a2e8d-64a9-45d4-8092-b0e803666ea7 for instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 on hv-cinder-83699 Jun 18 05:17:08.710021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-a47d5f6c-0e24-44ca-ab6b-3069e143535f req-c32949ee-222d-44ca-961f-fe9e827591c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040292 Jun 18 05:17:08.712158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 50/91] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:17:08.718445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:08.719302 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:08.732407 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.733625 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.735402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:08.736027 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:08.911253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:08.919963 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:08.924726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:08.926386 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c004f53e-278a-4bdb-84a7-225cc95ce852 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.214746 Jun 18 05:17:08.927550 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 42/92] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:08 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:09.236532 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:09.237821 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:09.254962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:09.255423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:09.257783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:09.258611 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:09.545717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:09.554474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-663d0e6c-33c2-4c43-90fc-a3dc7fcda4f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.322213 Jun 18 05:17:09.558370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 51/93] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:09 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:09.659256 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:09.660646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:09.669199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:09.669874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:09.671026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:09.671737 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:09.945977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:09.946962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:09.962685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:09.962685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:09.962685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:09.962685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:10.073658 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:10.082403 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a1caa51f-0905-4aca-aa7f-1cd13fb862a1 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.428046 Jun 18 05:17:10.115712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 43/94] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:09 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:10.142130 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:10.174020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:10.181306 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:10.185213 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d2c9ac2f-2df3-49a5-8cb6-765e4283684d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.241275 Jun 18 05:17:10.186147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 52/95] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:09 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:17:10.223569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-a3c07b5f-dac8-4321-9257-f4d4e07290a9 req-0fe3f8d4-1560-4198-9655-90366f452b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f277a3d-57bc-4fce-82d5-b163cbbcade0", "name": "network-vif-plugged", "status": "completed", "tag": "b7964cda-123c-4433-9d83-8d7e89fdef4a"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:10.239435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-a3c07b5f-dac8-4321-9257-f4d4e07290a9 req-0fe3f8d4-1560-4198-9655-90366f452b72 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:10.240147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-a3c07b5f-dac8-4321-9257-f4d4e07290a9 req-0fe3f8d4-1560-4198-9655-90366f452b72 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:10.281906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-a3c07b5f-dac8-4321-9257-f4d4e07290a9 req-0fe3f8d4-1560-4198-9655-90366f452b72 service nova] Creating event network-vif-plugged:b7964cda-123c-4433-9d83-8d7e89fdef4a for instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 on hv-cinder-83699 Jun 18 05:17:10.282822 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-a3c07b5f-dac8-4321-9257-f4d4e07290a9 req-0fe3f8d4-1560-4198-9655-90366f452b72 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117990) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 05:17:10.284655 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:10.285511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:10.286525 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:10.287162 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:10.297349 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.compute.rpcapi [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 18 05:17:10.298571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] Releasing lock "compute-rpcapi-router" {{(pid=117990) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 05:17:10.320068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a1c95e0d-ae98-4880-a40e-12712b292a9f None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235676 Jun 18 05:17:10.321179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 44/96] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:10.581686 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:10.585512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:10.611197 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:10.612129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:10.655981 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:10.662358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:10.860312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:10.869943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cd8fe134-02bb-42e1-8902-8def2b534ccd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.294413 Jun 18 05:17:10.882870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 53/97] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:10 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:11.125428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:11.128444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:11.138914 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:11.140884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:11.143846 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:11.146671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:11.223618 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:11.223618 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:11.236270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:11.238415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:11.239316 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:11.240521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:11.458967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:11.468555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6a817430-7263-4796-bcc1-da41f1bfd5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.348798 Jun 18 05:17:11.469467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 45/98] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:11 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:11.479558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:11.497326 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:11.498824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:11.499969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2cda723a-dcd8-46a3-b432-dbefdb27e6a7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.294385 Jun 18 05:17:11.500553 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 54/99] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:11 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:17:11.888618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:11.889976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:11.898604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:11.899533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:11.900478 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:11.901055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:12.053295 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:12.062404 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5317a9c2-2391-4fc4-8958-60c6c0496158 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.179217 Jun 18 05:17:12.063516 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 46/100] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:11 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:12.486847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:12.487510 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:12.498680 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:12.499315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:12.502435 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:12.503048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:12.520257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:12.520998 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:12.538967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:12.539600 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:12.541270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:12.543043 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:12.705229 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:12.731170 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-87bb2491-f147-4ecc-b8cf-5df7d373cd27 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.248086 Jun 18 05:17:12.745061 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 55/101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:12 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:12.813742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:12.829901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:12.829901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:12.829901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5497dfa1-8547-4d76-aafe-ebdd96677074 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.310773 Jun 18 05:17:12.830180 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 47/102] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:12 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:17:13.079764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:13.080729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:13.086849 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:13.087298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:13.088042 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:13.088472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:13.222184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:13.232378 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-51eb3428-c106-4ccf-bd65-7aa3f0dd5160 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.156329 Jun 18 05:17:13.233034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 56/103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:13 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:13.747691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:13.748387 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:13.754404 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:13.754932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:13.759190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:13.759190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:13.843227 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:13.843829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:13.849852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:13.850823 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:13.851577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:13.852190 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:13.893904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:13.904187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-311953fe-e42b-4add-93fb-921373225840 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.160632 Jun 18 05:17:13.904809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 48/104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:13 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:13.993029 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:14.002262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:14.003908 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:14.005094 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ddd0d581-cf89-4180-ba9a-6e83327ca9f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.165797 Jun 18 05:17:14.005750 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 57/105] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:13 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:17:14.251251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:14.252083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:14.260393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:14.261144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:14.262216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:14.262864 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:14.397664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:14.405871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6f7b0912-65d5-4a1e-8446-1d7c5087edd1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.158660 Jun 18 05:17:14.406576 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 49/106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:14 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:14.506137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-b2b8832e-d793-4f78-85b9-4f36cd596ea8 req-421d0440-6fa1-4e37-885b-b084cb29d3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d96c6-c2da-4ee1-8fd9-554944f65d95", "name": "network-vif-plugged", "status": "completed", "tag": "376a2e8d-64a9-45d4-8092-b0e803666ea7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:14.516476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-b2b8832e-d793-4f78-85b9-4f36cd596ea8 req-421d0440-6fa1-4e37-885b-b084cb29d3dd service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:14.517064 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-b2b8832e-d793-4f78-85b9-4f36cd596ea8 req-421d0440-6fa1-4e37-885b-b084cb29d3dd service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:14.530436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-b2b8832e-d793-4f78-85b9-4f36cd596ea8 req-421d0440-6fa1-4e37-885b-b084cb29d3dd service nova] Creating event network-vif-plugged:376a2e8d-64a9-45d4-8092-b0e803666ea7 for instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 on hv-cinder-83699 Jun 18 05:17:14.535944 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-b2b8832e-d793-4f78-85b9-4f36cd596ea8 req-421d0440-6fa1-4e37-885b-b084cb29d3dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035125 Jun 18 05:17:14.536641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 58/107] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:17:14.921142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:14.921889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:14.928167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:14.928834 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:14.929646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:14.930087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:15.025940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:15.026651 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:15.033013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:15.033475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:15.034281 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:15.034697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:15.067062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:15.075202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d59ada32-e669-4f2d-be1d-871ef26bcb1d tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.157903 Jun 18 05:17:15.075777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 50/108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:14 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:15.169055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:15.177179 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:15.179205 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:15.180312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-967f60ea-4dbe-41c6-9f40-123ce2cabe40 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.161261 Jun 18 05:17:15.180873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 59/109] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:15 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:15.424133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:15.424871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:15.431713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:15.432162 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:15.432905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:15.433337 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:15.631314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:15.640258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a83a128a-d738-443d-ab13-ca5023794e95 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.219954 Jun 18 05:17:15.645417 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 51/110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:15 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:16.092001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:16.092601 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:16.098746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.099199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.100021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.101037 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.202111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:16.203505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:16.225202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.228665 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.231438 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.233419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.250137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:16.258174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0ddc8647-031d-4500-87a7-0cf817a29609 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1315 microversion: 2.1 time: 0.170016 Jun 18 05:17:16.258819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 60/111] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:16 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:16.409252 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:16.418393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:16.420129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:16.421250 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c979c1bc-96bf-412d-96a2-aeff9b591e13 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.227227 Jun 18 05:17:16.422179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 52/112] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:16 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:16.557254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-ab228321-54d5-4e38-8904-e948b3b4c12a req-362d5380-58f9-4b0c-a060-b6e3e233fa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "name": "network-vif-plugged", "status": "completed", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:16.567530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-ab228321-54d5-4e38-8904-e948b3b4c12a req-362d5380-58f9-4b0c-a060-b6e3e233fa58 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.568214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-ab228321-54d5-4e38-8904-e948b3b4c12a req-362d5380-58f9-4b0c-a060-b6e3e233fa58 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.581697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-ab228321-54d5-4e38-8904-e948b3b4c12a req-362d5380-58f9-4b0c-a060-b6e3e233fa58 service nova] Creating event network-vif-plugged:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:17:16.587178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-ab228321-54d5-4e38-8904-e948b3b4c12a req-362d5380-58f9-4b0c-a060-b6e3e233fa58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033822 Jun 18 05:17:16.587781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 61/113] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:16.660697 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:16.661575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:16.668252 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.668700 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.669499 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:16.669928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:16.859437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:16.859437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:16.861533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dd3f6aab-60a5-41f5-ad68-40ea51e4bfb4 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1362 microversion: 2.1 time: 0.205007 Jun 18 05:17:16.862104 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 53/114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:16 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:17.275557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:17.276704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:17.298450 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:17.299324 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:17.300352 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:17.300960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:17.442777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:17.444067 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:17.452877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:17.453761 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:17.461083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:17.461653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:17.535758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:17.544820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b6175ac0-1aad-4b32-8f44-2ba6f493c935 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1503 microversion: 2.1 time: 0.274033 Jun 18 05:17:17.545666 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 62/115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:17 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:17.612379 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:17.628688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:17.628688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:17.628688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-52863369-672b-4d2f-861a-80c41c88ad87 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.188337 Jun 18 05:17:17.637178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 54/116] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:17 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:17.886273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:17.886905 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:17.894136 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:17.894578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:17.895505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:17.895939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:18.118552 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:18.127850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-62e35bed-e308-46c0-83ef-e6e33e1c86f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1548 microversion: 2.1 time: 0.246190 Jun 18 05:17:18.140896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 63/117] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:17 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1548 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:18.146225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:18.146732 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:18.158486 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:18.159204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:18.160060 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:18.160671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:18.346912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0e2eebc6-f551-4376-930b-24a78e612aeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204570 Jun 18 05:17:18.347541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 55/118] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:17:18 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:18.648270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:18.649444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:18.656520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:18.657225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:18.658080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:18.658509 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:18.823983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:18.839592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:18.841431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:18.843482 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-138e232e-01a3-440c-a719-8ca00cd8cb80 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.199703 Jun 18 05:17:18.847785 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 64/119] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:18 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:19.562092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac819cae-8537-4886-9161-3c736846f87f"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:19.563402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:19.570314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:19.570857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:19.571688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:19.572123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:19.867049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:19.867049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:19.875840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:19.876612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:19.877490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:19.878222 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:20.152022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:20.162083 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:20.166958 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:20.168339 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9b228df4-ea9f-407f-8c48-be137319f413 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1407 microversion: 2.20 time: 0.308005 Jun 18 05:17:20.180421 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 65/120] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:19 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:17:20.185580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-97e206c3-35eb-4c55-9548-625c38c5432f req-258be58c-9751-4956-b023-a01b75886c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240d96c6-c2da-4ee1-8fd9-554944f65d95", "tag": "376a2e8d-64a9-45d4-8092-b0e803666ea7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:20.194825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-97e206c3-35eb-4c55-9548-625c38c5432f req-258be58c-9751-4956-b023-a01b75886c0b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:20.196092 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-97e206c3-35eb-4c55-9548-625c38c5432f req-258be58c-9751-4956-b023-a01b75886c0b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:20.211317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-97e206c3-35eb-4c55-9548-625c38c5432f req-258be58c-9751-4956-b023-a01b75886c0b service nova] Creating event network-changed:376a2e8d-64a9-45d4-8092-b0e803666ea7 for instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 on hv-cinder-83699 Jun 18 05:17:20.237718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-97e206c3-35eb-4c55-9548-625c38c5432f req-258be58c-9751-4956-b023-a01b75886c0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053750 Jun 18 05:17:20.238595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 66/121] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:20.297187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:21.189545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:21.190779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:21.199907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:21.200445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:21.201212 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:21.201674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:21.223383 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:21.363953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6bceb3ca-e4c0-411a-9147-ad9f725923bb tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "POST /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.805180 Jun 18 05:17:21.365276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 56/122] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:17:19 2022] POST /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0/os-volume_attachments => generated 194 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:21.420641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:21.437984 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:21.439691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:21.442027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-92f3209e-454f-4a26-9083-927886cd2c9a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1598 microversion: 2.20 time: 0.258130 Jun 18 05:17:21.442810 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 67/123] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:17:21 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1598 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:17:21.464637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:21.464637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:21.479723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:21.480441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:21.482791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:21.483386 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:21.594021 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d3809ca9-2de7-4451-97ae-64c3e834e8e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.136688 Jun 18 05:17:21.595040 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 57/124] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Jun 18 05:17:21 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:17:23.130997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-9b02fe03-682d-4eb9-998e-26ddc29fd891 req-393492cd-f735-435c-b766-0569498b69b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:23.140844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9b02fe03-682d-4eb9-998e-26ddc29fd891 req-393492cd-f735-435c-b766-0569498b69b5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:23.141406 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9b02fe03-682d-4eb9-998e-26ddc29fd891 req-393492cd-f735-435c-b766-0569498b69b5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:23.161850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-9b02fe03-682d-4eb9-998e-26ddc29fd891 req-393492cd-f735-435c-b766-0569498b69b5 service nova] Creating event network-changed:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:17:23.175907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-9b02fe03-682d-4eb9-998e-26ddc29fd891 req-393492cd-f735-435c-b766-0569498b69b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050249 Jun 18 05:17:23.176336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 68/125] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:33.447179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:33.448530 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:33.459932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=32 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:33.462247 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:33.464447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:33.465139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:33.466289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:33.466974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:33.511010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:17:33.845999 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-90521ebb-e94f-413c-95d1-64cffbb0a0ad tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 204 len: 0 microversion: 2.1 time: 0.404659 Jun 18 05:17:33.846828 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 58/126] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:17:33 2022] DELETE /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:17:33.858410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=51 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:33.858410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:17:33.866846 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:33.867858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:33.874428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:33.875111 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:33.876130 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:33.876607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:34.029471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:34.037445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2ef1219b-4299-418b-a130-8904c772d442 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1555 microversion: 2.1 time: 0.185800 Jun 18 05:17:34.038103 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 69/127] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:33 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:35.055599 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:35.056377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:35.064054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:35.064511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:35.065281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:35.065750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:35.206332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:35.215078 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3e2c16d4-b7ab-45bf-a1d9-4f3cdd99c5c2 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1555 microversion: 2.1 time: 0.164195 Jun 18 05:17:35.215886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 59/128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:35 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:36.351173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:36.351173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:36.351173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:36.351173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:36.355323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:36.355323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:36.379113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:36.383522 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-be95f7aa-7fcc-4da3-8410-79927a1365aa tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1555 microversion: 2.1 time: 0.154654 Jun 18 05:17:36.384094 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 70/129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:36 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:37.400321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:37.400930 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:37.407505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:37.407950 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:37.408704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:37.409134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:37.536097 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:37.544628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-00c002e2-ffb1-4618-82c4-70f630f2d755 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1555 microversion: 2.1 time: 0.148587 Jun 18 05:17:37.545195 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 60/130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:37 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:38.561102 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:38.561737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:38.567630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:38.568079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:38.568825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:38.569256 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:38.699387 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:38.707398 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e1fbdce1-b8d8-43f9-884b-a5d982eda83c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1555 microversion: 2.1 time: 0.150048 Jun 18 05:17:38.708872 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 71/131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:38 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:39.725731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:39.726353 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:39.734898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:39.735481 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:39.736478 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:39.736909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:40.159161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:40.168803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2ed3004d-3d0a-4ed7-8460-1e570daa061c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1555 microversion: 2.1 time: 0.447405 Jun 18 05:17:40.179041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 61/132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:39 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1555 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:40.562679 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-997aba97-dd51-40da-aa5b-7d3a6088056a req-66c13410-27f2-4a88-a572-cccc5ef24f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f277a3d-57bc-4fce-82d5-b163cbbcade0", "name": "network-vif-deleted", "tag": "b7964cda-123c-4433-9d83-8d7e89fdef4a"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:17:40.575219 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-997aba97-dd51-40da-aa5b-7d3a6088056a req-66c13410-27f2-4a88-a572-cccc5ef24f1b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:40.576159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-997aba97-dd51-40da-aa5b-7d3a6088056a req-66c13410-27f2-4a88-a572-cccc5ef24f1b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:40.590113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-997aba97-dd51-40da-aa5b-7d3a6088056a req-66c13410-27f2-4a88-a572-cccc5ef24f1b service nova] Creating event network-vif-deleted:b7964cda-123c-4433-9d83-8d7e89fdef4a for instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 on hv-cinder-83699 Jun 18 05:17:40.597070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-997aba97-dd51-40da-aa5b-7d3a6088056a req-66c13410-27f2-4a88-a572-cccc5ef24f1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042782 Jun 18 05:17:40.598536 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 72/133] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:17:41.186652 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:41.187410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:41.201518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:41.204389 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:41.205516 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:41.206117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:41.313630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:41.323940 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ba4cf992-cb61-47f9-95fa-196fcd976c2b tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1346 microversion: 2.1 time: 0.141584 Jun 18 05:17:41.333093 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 62/134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:41 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:42.341655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:42.342339 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:42.348534 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:42.349007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:42.350129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:42.350557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:42.383184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:42.384363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:42.384830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lazy-loading 'fault' on Instance uuid 7f277a3d-57bc-4fce-82d5-b163cbbcade0 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:17:42.430943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:42.439030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-55a123f9-210d-474d-8332-a97625fb17da tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1351 microversion: 2.1 time: 0.102701 Jun 18 05:17:42.439793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 73/135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:42 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:17:43.459373 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:43.459987 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:43.471712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:43.472220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:43.473053 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:43.473588 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:43.512571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:43.513013 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:43.513497 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lazy-loading 'fault' on Instance uuid 7f277a3d-57bc-4fce-82d5-b163cbbcade0 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:17:43.566533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f8817a70b844d7ac49543d74d0e38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b73d42a085a45bfb3ccced90b190a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:17:43.575106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b3a80173-050b-4200-b186-474db9438dd6 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 200 len: 1351 microversion: 2.1 time: 0.119873 Jun 18 05:17:43.575913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 63/136] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:43 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:17:44.597255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:44.600193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:44.604938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:44.605405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:44.606287 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:44.606724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:44.620499 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] HTTP exception thrown: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Request method failure captured: Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 HTTP/1.1 Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-2dC8A_fPT2jVFGXs8udyqhivSvLsEN90Ggp28jtqifO8IEQ_R8P93HBZYVAecgPu7RpudNLtd37NsPUp1pcbYIYekhtcZaK9h8zmiMGAlvB6bZZrIrHE0ucsZCp3BfUVC8_LaJH1jxk9VHh0zA7r99WRfa8MuL27PTHdubie_ob4 Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:17:44.625276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b73d42a085a45bfb3ccced90b190a5b"}]}] Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 79f8817a70b844d7ac49543d74d0e38b Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.626739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '7f277a3d-57bc-4fce-82d5-b163cbbcade0'} Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:17:44.627547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.629397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.630476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Returning 404 to user: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:17:44.630476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-03231c45-00e5-41c8-b9c2-d29641d397c9 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 404 len: 111 microversion: 2.1 time: 0.036287 Jun 18 05:17:44.630476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 74/137] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:44 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:17:44.748046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:44.749025 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:44.756321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:44.756765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:44.757575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:44.758010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:44.772909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] HTTP exception thrown: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Request method failure captured: Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0/os-volume_attachments HTTP/1.1 Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV-2dC8A_fPT2jVFGXs8udyqhivSvLsEN90Ggp28jtqifO8IEQ_R8P93HBZYVAecgPu7RpudNLtd37NsPUp1pcbYIYekhtcZaK9h8zmiMGAlvB6bZZrIrHE0ucsZCp3BfUVC8_LaJH1jxk9VHh0zA7r99WRfa8MuL27PTHdubie_ob4 Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:17:44.778702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b73d42a085a45bfb3ccced90b190a5b"}]}] Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 79f8817a70b844d7ac49543d74d0e38b Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.780218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'server_id': '7f277a3d-57bc-4fce-82d5-b163cbbcade0'} Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:17:44.781026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:44.782435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:44.783718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Returning 404 to user: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:17:44.783718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-508f485a-89b6-4979-a046-1211c648df2c tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036252 Jun 18 05:17:44.783718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 64/138] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:17:44 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:17:47.247355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:47.248003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:47.254210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:47.254668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:47.255448 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:47.256041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:47.271381 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] HTTP exception thrown: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Request method failure captured: Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 HTTP/1.1 Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-2dC8A_fPT2jVFGXs8udyqhivSvLsEN90Ggp28jtqifO8IEQ_R8P93HBZYVAecgPu7RpudNLtd37NsPUp1pcbYIYekhtcZaK9h8zmiMGAlvB6bZZrIrHE0ucsZCp3BfUVC8_LaJH1jxk9VHh0zA7r99WRfa8MuL27PTHdubie_ob4 Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:17:47.272927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b73d42a085a45bfb3ccced90b190a5b"}]}] Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 79f8817a70b844d7ac49543d74d0e38b Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.274385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '7f277a3d-57bc-4fce-82d5-b163cbbcade0'} Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:17:47.275498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.276787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.278113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Returning 404 to user: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:17:47.278113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-046a7829-2505-4a9f-b5b7-2858a9716797 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 404 len: 111 microversion: 2.1 time: 0.031582 Jun 18 05:17:47.278113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 75/139] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:17:47 2022] DELETE /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:17:47.283476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:17:47.284089 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] [instance: 7f277a3d-57bc-4fce-82d5-b163cbbcade0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:17:47.291351 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:47.291791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:47.292544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:17:47.292977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:17:47.309020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] HTTP exception thrown: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Request method failure captured: Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 HTTP/1.1 Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV-2dC8A_fPT2jVFGXs8udyqhivSvLsEN90Ggp28jtqifO8IEQ_R8P93HBZYVAecgPu7RpudNLtd37NsPUp1pcbYIYekhtcZaK9h8zmiMGAlvB6bZZrIrHE0ucsZCp3BfUVC8_LaJH1jxk9VHh0zA7r99WRfa8MuL27PTHdubie_ob4 Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:17:47.311208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b73d42a085a45bfb3ccced90b190a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b73d42a085a45bfb3ccced90b190a5b"}]}] Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 0b73d42a085a45bfb3ccced90b190a5b Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-DeleteServersTestJSON-1260896433 Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 79f8817a70b844d7ac49543d74d0e38b Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-DeleteServersTestJSON-1260896433-project Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.312718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '7f277a3d-57bc-4fce-82d5-b163cbbcade0'} Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:17:47.313467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. Jun 18 05:17:47.314501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:17:47.315456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] Returning 404 to user: Instance 7f277a3d-57bc-4fce-82d5-b163cbbcade0 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:17:47.315456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8faa1ccb-5076-4b40-b284-047809d13589 tempest-DeleteServersTestJSON-1260896433 tempest-DeleteServersTestJSON-1260896433-project] 10.222.0.23 "GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0" status: 404 len: 111 microversion: 2.1 time: 0.033016 Jun 18 05:17:47.315456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 65/140] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:17:47 2022] GET /compute/v2.1/servers/7f277a3d-57bc-4fce-82d5-b163cbbcade0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:18:01.897946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=16 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:01.911532 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=32 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:02.185750 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-879153851", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:02.313618 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] validate_networks() for [('e40c5bf8-60a8-4d08-b489-6f107ba55c42', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:18:02.857657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:18:02.859030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:18:02.859524 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:18:02.860672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:18:02.861105 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:18:02.873907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:02.875521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:02.876962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:02.877530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:02.907401 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for project 8820096253064e5abbe50f23bdc3ebac. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:18:02.912643 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for user 216d2b492c55410d9563051142048160 and project 8820096253064e5abbe50f23bdc3ebac. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:18:02.932070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:18:02.934800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:18:03.123867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b328823f-e326-4ffe-ab72-69e2e97c5b01 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.230979 Jun 18 05:18:03.124957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 76/141] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:18:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 05:18:03.135733 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f79d0124-ee49-40f4-a37c-ba13aef41dd8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:03.136366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f79d0124-ee49-40f4-a37c-ba13aef41dd8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:03.143925 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:03.146006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:03.244483 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f79d0124-ee49-40f4-a37c-ba13aef41dd8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:03.272894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f79d0124-ee49-40f4-a37c-ba13aef41dd8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1221 microversion: 2.1 time: 0.134888 Jun 18 05:18:03.278562 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 66/142] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:03 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:03.362772 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1740206463", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:03.445699 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] validate_networks() for [('e40c5bf8-60a8-4d08-b489-6f107ba55c42', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:18:04.383067 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:18:04.383674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:18:04.384109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:18:04.384672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:18:04.385081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:18:04.443962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:04.444431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:04.445266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:04.445676 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:04.531732 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for project 8820096253064e5abbe50f23bdc3ebac. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:18:04.538153 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for user 216d2b492c55410d9563051142048160 and project 8820096253064e5abbe50f23bdc3ebac. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:18:04.573940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:18:04.575967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:18:04.888491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c1b177d4-cd7b-4a27-b312-c09c64514c0d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.531987 Jun 18 05:18:04.894715 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 77/143] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:18:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:18:04.901174 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c0996366-e9f4-4131-8a10-09b067c513cd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:04.902942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c0996366-e9f4-4131-8a10-09b067c513cd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:05.004537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c0996366-e9f4-4131-8a10-09b067c513cd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:05.020251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c0996366-e9f4-4131-8a10-09b067c513cd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1222 microversion: 2.1 time: 0.124874 Jun 18 05:18:05.022783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 67/144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:04 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:06.040229 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:06.041420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:06.050640 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:06.051085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:06.051875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:06.052336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:06.123011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:06.132203 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-da214403-ed99-4c6e-bb2d-30a97d7e4be6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1226 microversion: 2.1 time: 0.095688 Jun 18 05:18:06.143657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 78/145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:06 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:07.154827 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:07.155532 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:07.176545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:07.177033 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:07.183907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:07.184495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:07.294691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:07.311960 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0476a0f2-b7cd-4f75-bca7-55253e795583 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1274 microversion: 2.1 time: 0.165343 Jun 18 05:18:07.323604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 68/146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:07 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:08.328828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:08.330221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:08.339064 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:08.339825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:08.340815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:08.341467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:08.504397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:08.521019 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7c7049fd-7c8e-413b-a9a1-1986c3f46ee8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1282 microversion: 2.1 time: 0.191753 Jun 18 05:18:08.523989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 79/147] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:08 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:09.540932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:09.542224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:09.554924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:09.555382 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:09.556884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:09.557420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:09.734675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:09.743437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c0105635-1a18-4eca-9e9f-434c0b3005f4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1280 microversion: 2.1 time: 0.206677 Jun 18 05:18:09.745236 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 69/148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:09 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:10.763634 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:10.765527 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:10.780917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:10.782551 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:10.783687 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:10.785924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:10.987213 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:10.991549 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ab60763d-28da-434d-a5d1-7fe407fe8805 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1280 microversion: 2.1 time: 0.234011 Jun 18 05:18:11.001506 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 80/149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:10 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:12.010783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:12.011909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:12.033369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:12.034838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:12.037231 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:12.041929 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:13.034069 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:13.050742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-463a1738-aeb3-47d9-97c0-49fa14f77218 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 1.046241 Jun 18 05:18:13.051341 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 70/150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:12 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:13.576014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-9500ff3a-4a47-4522-9f77-42445c553ab0 req-75188f7c-6270-46bc-b9a9-d27782c59ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b2fdbe-e24f-4092-bf52-db5c0a24f250", "tag": "f8f8ec04-f267-4e2c-ac94-64d18aec5016"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:13.596379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9500ff3a-4a47-4522-9f77-42445c553ab0 req-75188f7c-6270-46bc-b9a9-d27782c59ebd service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:13.604746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9500ff3a-4a47-4522-9f77-42445c553ab0 req-75188f7c-6270-46bc-b9a9-d27782c59ebd service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:13.644945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-9500ff3a-4a47-4522-9f77-42445c553ab0 req-75188f7c-6270-46bc-b9a9-d27782c59ebd service nova] Creating event network-changed:f8f8ec04-f267-4e2c-ac94-64d18aec5016 for instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 on hv-cinder-83699 Jun 18 05:18:13.674340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-9500ff3a-4a47-4522-9f77-42445c553ab0 req-75188f7c-6270-46bc-b9a9-d27782c59ebd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102417 Jun 18 05:18:13.675544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 81/151] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:18:14.068079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:14.068854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:14.078571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:14.081235 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:14.082218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:14.084967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:14.750838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:14.766660 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f94c337f-914a-4f75-a3d8-7f9ec4f70905 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.701005 Jun 18 05:18:14.773740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 71/152] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:14 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:15.792970 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:15.795380 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=12 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:15.810525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:15.811649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:15.829829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:15.834825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:15.835917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:15.836581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:16.093169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:16.102556 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-04838c5f-da88-4a6a-9e2f-5a84cc7a9c04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.310532 Jun 18 05:18:16.103161 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 82/153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:15 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:16.202763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-d914ea28-fbd8-4ffd-bada-fa6802845cf4 req-86beaad7-8002-4449-ae05-8fba556c4ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b8a5eb5-afb5-4209-9aa5-b38844bf07f2", "tag": "8e5d7c91-931e-49de-80d5-fe09b507ebe5"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:16.202763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=4 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:16.202763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-d914ea28-fbd8-4ffd-bada-fa6802845cf4 req-86beaad7-8002-4449-ae05-8fba556c4ec3 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:16.202763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-d914ea28-fbd8-4ffd-bada-fa6802845cf4 req-86beaad7-8002-4449-ae05-8fba556c4ec3 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:16.203651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-d914ea28-fbd8-4ffd-bada-fa6802845cf4 req-86beaad7-8002-4449-ae05-8fba556c4ec3 service nova] Creating event network-changed:8e5d7c91-931e-49de-80d5-fe09b507ebe5 for instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 on hv-cinder-83699 Jun 18 05:18:16.203651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-d914ea28-fbd8-4ffd-bada-fa6802845cf4 req-86beaad7-8002-4449-ae05-8fba556c4ec3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040726 Jun 18 05:18:16.203651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 72/154] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:18:17.123269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:17.123902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:17.131148 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:17.131910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:17.132938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:17.133608 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:17.343719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:17.353999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2c9ec2d4-f1f7-4ba9-9c85-e14d4a446ac0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.237278 Jun 18 05:18:17.364135 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 83/155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:17 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:18.377732 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:18.377732 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:18.389275 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:18.403500 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:18.406220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:18.406220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:18.608546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:18.616678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2c002162-a1e1-4909-97f2-327f45910859 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.249303 Jun 18 05:18:18.617254 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 73/156] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:18 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:19.648115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:19.648837 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:19.663404 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:19.663867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:19.664620 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:19.665055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:19.710126 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:19.710721 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:19.719343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:19.719898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:19.720869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:19.721514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:19.744439 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a0e1ccf5-b394-41af-a54b-626d208f658d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/ips" status: 200 len: 151 microversion: 2.20 time: 0.038749 Jun 18 05:18:19.745012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 74/157] 10.222.0.23 () {60 vars in 1288 bytes} [Sat Jun 18 05:18:19 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 05:18:19.824776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:19.832056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d9f44ffc-32e9-4c10-932b-e46b311ce5d9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.202183 Jun 18 05:18:19.832616 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 84/158] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:19 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:20.850059 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:20.851316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:20.859676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:20.860318 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:20.861272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:20.862302 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:21.020146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:21.027976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4f8d84be-0c3a-4bef-8237-cc17caae6521 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.182227 Jun 18 05:18:21.028543 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 75/159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:20 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:21.111875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ce58c399-bc2a-4cc2-a2d5-bcc5cf7ed4f2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Action: 'create', calling method: .version_select at 0x7f7b01a681f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-394344384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVIlq3E6grhJdzVw4juMUK2ZxWfIxjHrH4WktmIH6bzAWAh3zVa0Fka3sotEFN0opGwBUPBOQBPDB0ihz8W3kTSb7J5DWHDiXbuGMIhOUMuvZ6+rhs3RWjKmke1RnmajA=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:21.127713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-ce58c399-bc2a-4cc2-a2d5-bcc5cf7ed4f2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Getting quotas for project 3a833f00ba294564a66b9eefbc49147e. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:18:21.131578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-ce58c399-bc2a-4cc2-a2d5-bcc5cf7ed4f2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Getting quotas for user 113fba3872764b02bcbcc69299d8768f and project 3a833f00ba294564a66b9eefbc49147e. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:18:21.235371 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ce58c399-bc2a-4cc2-a2d5-bcc5cf7ed4f2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.127206 Jun 18 05:18:21.248184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 85/160] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:18:21 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:21.345289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-415818792", "imageRef": "33dd0d5c-a795-41cb-93b6-45671ed8a780", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-394344384", "networks": [{"uuid": "381e581a-9cea-44f2-9ed2-365c11f6d6d9"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:21.399163 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] validate_networks() for [('381e581a-9cea-44f2-9ed2-365c11f6d6d9', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:18:21.987003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:18:21.987656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:18:21.987908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:18:21.988363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:18:21.989495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:18:22.003009 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:22.003846 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:22.004702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:22.005134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:22.022791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Getting quotas for project 3a833f00ba294564a66b9eefbc49147e. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:18:22.027876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Getting quotas for user 113fba3872764b02bcbcc69299d8768f and project 3a833f00ba294564a66b9eefbc49147e. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:18:22.042919 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:18:22.045202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33dd0d5c-a795-41cb-93b6-45671ed8a780',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:18:22.046449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:22.047426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:22.057646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:22.058465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:22.059476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:22.059997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:22.203522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-78ffe264-34d8-47bb-8d4b-d02421316e5b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862062 Jun 18 05:18:22.204191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 76/161] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:18:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:18:22.216958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b2e093ed-ca8b-4554-8ed9-80760d4d4572 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:22.217957 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b2e093ed-ca8b-4554-8ed9-80760d4d4572 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:22.282548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b2e093ed-ca8b-4554-8ed9-80760d4d4572 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:22.286346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:22.291942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b2e093ed-ca8b-4554-8ed9-80760d4d4572 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1257 microversion: 2.1 time: 0.081390 Jun 18 05:18:22.293037 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 77/162] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:22 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:22.295594 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-eb836338-54c0-4754-884c-b0d9e747280c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.255409 Jun 18 05:18:22.309408 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 86/163] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:22 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:22.758605 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-cc51a01c-d72f-49a7-8240-0efd8edef372 req-330af3f3-f75a-463c-962b-e1d4c6bc750b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b2fdbe-e24f-4092-bf52-db5c0a24f250", "name": "network-vif-plugged", "status": "completed", "tag": "f8f8ec04-f267-4e2c-ac94-64d18aec5016"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:22.771102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-cc51a01c-d72f-49a7-8240-0efd8edef372 req-330af3f3-f75a-463c-962b-e1d4c6bc750b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:22.772710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-cc51a01c-d72f-49a7-8240-0efd8edef372 req-330af3f3-f75a-463c-962b-e1d4c6bc750b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:22.789872 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-cc51a01c-d72f-49a7-8240-0efd8edef372 req-330af3f3-f75a-463c-962b-e1d4c6bc750b service nova] Creating event network-vif-plugged:f8f8ec04-f267-4e2c-ac94-64d18aec5016 for instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 on hv-cinder-83699 Jun 18 05:18:22.795485 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-cc51a01c-d72f-49a7-8240-0efd8edef372 req-330af3f3-f75a-463c-962b-e1d4c6bc750b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043513 Jun 18 05:18:22.797545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 78/164] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:23.309548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0237fe37-c904-4d37-a997-8bf67f5c0198 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:23.310174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0237fe37-c904-4d37-a997-8bf67f5c0198 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:23.320853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:23.322398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:23.331334 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:23.333554 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:23.337600 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:23.338288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:23.436462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0237fe37-c904-4d37-a997-8bf67f5c0198 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:23.450612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0237fe37-c904-4d37-a997-8bf67f5c0198 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1257 microversion: 2.1 time: 0.143589 Jun 18 05:18:23.452020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 87/165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:23 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1257 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:23.639635 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:23.650279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-99f9a2c3-1fda-4056-80f3-9f68ef4e0613 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.334366 Jun 18 05:18:23.650870 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 79/166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:23 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:24.355262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:24.356597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:24.371497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:24.372249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:24.373237 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:24.382008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:24.468181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:24.469681 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:24.487609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:24.489041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:24.492001 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:24.493145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:24.497035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lazy-loading 'flavor' on Instance uuid 3db86af8-06be-4481-ae05-85abb634d58e {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:18:24.577495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:24.585937 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-efe3f424-2c7a-43f8-bf8b-01428691aed3 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1261 microversion: 2.1 time: 0.122297 Jun 18 05:18:24.586518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 80/167] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:24 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1261 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:24.668503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:24.669111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:24.675485 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:24.676313 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:24.677772 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:24.678408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:24.836671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:24.852020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3dc949f7-d77f-49a4-80ef-b8fdac80cc8b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.187875 Jun 18 05:18:24.861896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 81/168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:24 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:25.327177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a7f529e1-3be3-473a-a161-430c00b671d6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/action" status: 202 len: 0 microversion: 2.20 time: 0.980253 Jun 18 05:18:25.330792 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 88/169] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 05:18:24 2022] POST /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/action => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:18:25.336953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:25.340098 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:25.353793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:25.354280 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:25.355206 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:25.357278 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:25.604068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:25.607596 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:25.623193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:25.623651 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:25.624435 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:25.625050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:25.628668 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:25.647153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:25.648805 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:25.650192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-552d7899-8f1b-46c8-8f34-0c59f74b4076 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.317668 Jun 18 05:18:25.657944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 82/170] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:25 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:25.724619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:25.734802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5a4cd17e-b723-499a-9b51-91ea1bed2746 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1309 microversion: 2.1 time: 0.135261 Jun 18 05:18:25.735680 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 89/171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:25 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:25.880964 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:25.882856 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:25.894060 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:25.894761 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:25.896152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:25.897201 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:26.166590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:26.180863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-23a4fac9-76f6-48c2-8940-5991c1c0306e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.315798 Jun 18 05:18:26.181497 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 83/172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:25 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:26.677303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:26.679711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:26.684462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:26.684910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:26.685704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:26.686623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:26.753703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:26.755120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:26.778100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:26.779767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:26.782182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:26.783670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:26.905791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:26.923307 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a434f8ba-5c4b-4888-bc5f-8823a36e3016 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1317 microversion: 2.1 time: 0.174868 Jun 18 05:18:26.937871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 84/173] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:26 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:26.985939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:26.995617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:26.997503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:26.998700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-38983cff-13b2-45a7-8fc7-7e15d05d4e53 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.326463 Jun 18 05:18:26.999262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 90/174] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:26 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:27.197647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:27.198683 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:27.212501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:27.212954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:27.215912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:27.216398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:27.363169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-2d647c40-1ab0-4d07-95f9-d6d47841c01f req-4a567977-c5d3-4950-aaf2-376981d50fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b8a5eb5-afb5-4209-9aa5-b38844bf07f2", "name": "network-vif-plugged", "status": "completed", "tag": "8e5d7c91-931e-49de-80d5-fe09b507ebe5"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:27.386173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-2d647c40-1ab0-4d07-95f9-d6d47841c01f req-4a567977-c5d3-4950-aaf2-376981d50fd5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:27.392291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-2d647c40-1ab0-4d07-95f9-d6d47841c01f req-4a567977-c5d3-4950-aaf2-376981d50fd5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:27.417452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-2d647c40-1ab0-4d07-95f9-d6d47841c01f req-4a567977-c5d3-4950-aaf2-376981d50fd5 service nova] Creating event network-vif-plugged:8e5d7c91-931e-49de-80d5-fe09b507ebe5 for instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 on hv-cinder-83699 Jun 18 05:18:27.418916 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-2d647c40-1ab0-4d07-95f9-d6d47841c01f req-4a567977-c5d3-4950-aaf2-376981d50fd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060206 Jun 18 05:18:27.419877 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 91/175] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:27.593241 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:27.602309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-49a07860-9bce-4e8c-a1bc-f0c94d983495 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.409104 Jun 18 05:18:27.605440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 85/176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:27 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:27.947040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:27.948598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:27.960361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:27.961234 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:27.962476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:27.963935 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:28.033881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:28.034703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:28.059216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:28.059721 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:28.062968 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:28.063496 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:28.276977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:28.287944 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7ef4b16a-913d-4bd6-aa49-6cde4f58c8e4 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.347324 Jun 18 05:18:28.289071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 92/177] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:27 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:28.294289 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:28.294925 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:28.308403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:28.308403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:28.308403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:28.308613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:28.339960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-41b4f76d-b203-4694-a735-5ffb116fdd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/ips" status: 200 len: 145 microversion: 2.1 time: 0.049463 Jun 18 05:18:28.345749 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 93/178] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:18:28 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:28.383698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:28.392759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:28.394299 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:28.395484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0afe1f83-a0dd-4439-8c85-7dbc08aa033f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.375259 Jun 18 05:18:28.396034 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 86/179] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:28 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:28.620791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:28.621538 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:28.628446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:28.628868 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:28.633095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:28.633095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:29.241689 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:29.251099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a49fb5c2-f1bd-4487-b0be-4eab808703b5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1322 microversion: 2.1 time: 0.635942 Jun 18 05:18:29.263671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 94/180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:28 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:29.312609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:29.316367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:29.346732 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:29.347426 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:29.350545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:29.352482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:29.414396 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:29.415419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:29.427854 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:29.428536 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:29.429823 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:29.432790 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:29.499541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:29.891536 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:29.904289 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:29.918657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:29.920140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3c1cc9b6-f1a2-4a18-9dfb-2291b21bdc76 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.510167 Jun 18 05:18:29.923341 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 95/181] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:29 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:18:30.127378 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:30.135350 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:30.146244 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-da321f70-144b-4d39-828e-707c512e1970 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.838957 Jun 18 05:18:30.154775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 87/182] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:29 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:30.291069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:30.291696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:30.308048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:30.308972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:30.310249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:30.310938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:30.943717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:30.944482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:30.960994 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:30.964621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:30.965616 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:30.966069 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:31.282402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:31.292556 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-272e0b20-b433-45c8-90c4-ccfdef032a8e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1516 microversion: 2.1 time: 1.015643 Jun 18 05:18:31.307900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 96/183] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:30 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1516 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:31.318408 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:31.320874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:31.347518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:31.349244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:31.365065 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:31.365065 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:31.418807 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:31.432396 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:31.453177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:31.458041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-05966208-1281-4e8e-ae81-623575f489bf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.520189 Jun 18 05:18:31.461588 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 88/184] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:30 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:31.502631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:31.506288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:31.526640 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:31.526640 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:31.533705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:31.537257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:31.667342 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'flavor' on Instance uuid 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:18:32.007796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:32.026192 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-70867e89-8245-4b73-90f0-e5bdabe85c8e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.717337 Jun 18 05:18:32.028362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 97/185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:31 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:32.047194 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-193bf89d-e03a-4577-bda8-6f13f468f05e req-bbf12510-b83f-4f14-9e86-11253e1f9770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:32.056398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:32.089723 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-193bf89d-e03a-4577-bda8-6f13f468f05e req-bbf12510-b83f-4f14-9e86-11253e1f9770 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:32.090539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-193bf89d-e03a-4577-bda8-6f13f468f05e req-bbf12510-b83f-4f14-9e86-11253e1f9770 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:32.140225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-193bf89d-e03a-4577-bda8-6f13f468f05e req-bbf12510-b83f-4f14-9e86-11253e1f9770 service nova] Creating event network-changed:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:18:32.153496 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-193bf89d-e03a-4577-bda8-6f13f468f05e req-bbf12510-b83f-4f14-9e86-11253e1f9770 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120683 Jun 18 05:18:32.154773 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 98/186] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:32.175308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8988565-d468-4656-94db-8a1c151a5fde"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:32.181290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:32.193369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:32.194717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:32.196401 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:32.198070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:32.248832 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d8b6a7d4-601c-4e59-a6ce-bfa2d25de9f1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2/action" status: 200 len: 32 microversion: 2.1 time: 0.785163 Jun 18 05:18:32.253579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 89/187] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:18:31 2022] POST /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2/action => generated 32 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:18:32.258937 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:32.262591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:32.289657 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=8 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:32.324074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:32.324462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:32.338606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:32.341511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:33.242841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-886bc5e2-324b-4abf-8094-5a11c71ab968 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.086380 Jun 18 05:18:33.258478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 99/188] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:18:32 2022] POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-volume_attachments => generated 194 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:33.259146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:33.262902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:33.279818 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:33.284364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:33.285244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:33.286461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:33.287294 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:33.452261 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=6 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:33.931615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:33.955199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ba0d3ef2-98a7-4134-a27a-f299c04f435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 1.700730 Jun 18 05:18:33.956990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 90/189] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:32 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:33.975459 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:33.979028 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:34.004620 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:34.005808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:34.020688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:34.021072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:34.671634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:34.679139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-085e669d-b86e-48bc-8a6d-935f035f0e9e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.720911 Jun 18 05:18:34.679719 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 91/190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:33 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:34.787808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:34.808854 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:34.810343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:34.819637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-10647fc6-d44e-4752-a7fd-b4d0ad54bd82 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 1.571544 Jun 18 05:18:34.823734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 100/191] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:33 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:34.974363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:34.974945 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:34.991397 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:34.992022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:34.992942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:34.995819 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:35.420657 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:35.437884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-aa7d0177-d328-4fb3-a023-a2bd5dd1435b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.469143 Jun 18 05:18:35.449934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 92/192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:34 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:35.698162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:35.699134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:35.709190 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:35.709672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:35.720568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:35.720568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:35.840708 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:35.841325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:35.864077 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:35.864623 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:35.865565 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:35.873657 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:36.220996 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:36.228265 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:36.234125 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:36.235663 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:36.237333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-35d244f1-4b7e-4e94-962a-ee2dfe8573c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.400666 Jun 18 05:18:36.247130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 93/193] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:35 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:36.250337 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b330a999-202a-4260-9ffe-47b3b9e0114d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.557918 Jun 18 05:18:36.252813 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 101/194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:35 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:36.272346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-592688319", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "networks": [{"uuid": "4041b16e-d0bc-408d-92a3-b2c03aff6ddd"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:36.457794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:36.458665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:36.468643 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:36.476546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:36.477409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:36.479929 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:36.839077 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:36.850230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-61c7d24e-a6fb-4eff-945f-26eb773515db tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.396565 Jun 18 05:18:36.866434 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 102/195] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:36 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:37.258437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:37.259973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:37.266431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:37.267071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:37.267942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:37.268479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:37.658459 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:37.675412 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:37.676981 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:37.678209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-74c0583f-f378-4969-8c9c-cb44a5f8ecdc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.424916 Jun 18 05:18:37.678772 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 103/196] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:37 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:37.698013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:37.699023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:37.710032 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:37.710698 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:37.711661 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:37.712285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:37.973766 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:37.984183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b36b94da-1934-4b96-bc28-737fdea60767 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.304054 Jun 18 05:18:37.984914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 104/197] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:37 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:37.991204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:37.991927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:37.999267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:38.000141 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:38.001471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:38.002098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:38.314254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:38.331623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9a408af8-ca8b-4f60-8191-f1896112f911 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.344625 Jun 18 05:18:38.337930 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 105/198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:37 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:38.698682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:38.699660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:38.712671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:38.713942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:38.719430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:38.719876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:38.909849 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:38.941157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:38.953376 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:38.958263 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-889c5645-d012-4111-8665-1c7c425f81f2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.264547 Jun 18 05:18:38.959401 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 106/199] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:38 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:18:39.007834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:39.009346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:39.020373 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:39.020841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:39.021885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:39.022625 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:39.279082 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:39.289431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e867e455-3c95-4f82-86f6-552898142d2b tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.285918 Jun 18 05:18:39.289431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 107/200] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:39 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:39.355473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:39.356841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:39.370669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:39.371472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:39.372498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:39.373140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:39.753746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:39.773963 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-66d8d974-97af-4a04-91e5-58f4781c7e22 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.422364 Jun 18 05:18:39.776085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 108/201] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:39 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:39.985461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:39.987246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:40.002539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:40.007064 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:40.008697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:40.009961 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:40.388787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:40.427612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:40.438450 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:40.448180 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-478afd90-ba3a-40c9-8540-1f9e42eb9cdf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.458458 Jun 18 05:18:40.448180 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 109/202] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:39 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:40.459391 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:40.460301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:40.471274 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:40.471274 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:40.471274 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:40.471274 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:40.727627 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:40.737345 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-669ede07-c35c-454a-8ca5-7970205a3421 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.288442 Jun 18 05:18:40.738382 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 110/203] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:40 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:40.791841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:40.792813 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:40.804902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:40.809210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:40.810333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:40.814994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:40.875898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:41.132158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:41.172804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e1a782a6-4733-43bb-82e3-36d2c1435ebc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.385835 Jun 18 05:18:41.173673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 111/204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:40 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:41.469186 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:41.470607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:41.477013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:41.478253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:41.479181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:41.479794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:41.723535 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:41.749967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:41.750351 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:41.751726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d74bdef2-4c15-494a-83cd-5a6f919073b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.286453 Jun 18 05:18:41.753996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 112/205] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:41 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:41.777109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:41.777656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:41.787994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:41.788830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:41.789906 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:41.791040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:42.062682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:42.070882 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a7acefac-ebee-452f-98aa-efc411d64e27 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.316075 Jun 18 05:18:42.079035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 113/206] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:41 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:42.190821 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:42.192392 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:42.200325 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:42.200548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:42.201393 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:42.202059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:42.423501 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:42.437961 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-593ad1a0-a10a-4b76-8db4-2d3c69d64c7f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.251265 Jun 18 05:18:42.441693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 114/207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:42 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:42.474765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] validate_networks() for [('4041b16e-d0bc-408d-92a3-b2c03aff6ddd', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:18:42.779183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:42.779960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:42.799046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:42.799610 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:42.800489 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:42.801077 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.023528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:18:43.024767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:18:43.026529 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:18:43.027942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:18:43.029414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:18:43.033795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:43.047084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:43.048612 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.049621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:43.050070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.072583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Getting quotas for project a63728833c434410864d0d7431a9fac2. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:18:43.077757 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Getting quotas for user 4147695d07c24202b096fb7da07ecf37 and project a63728833c434410864d0d7431a9fac2. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:18:43.096298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:18:43.098613 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:18:43.193139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:43.203264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:43.205742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:43.206106 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-992cb776-ada2-460a-9301-2d4a86e98db1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.433176 Jun 18 05:18:43.206710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 115/208] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:42 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:43.275364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-910c85ee-136d-41fe-bdeb-843653eab94b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.010675 Jun 18 05:18:43.276029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 94/209] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 7013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:18:43.281771 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:43.282707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:43.292866 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:43.293325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.294226 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:43.294672 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.484823 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-936e1e21-ae54-4b6e-ac35-1f7436341f4b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Action: 'create', calling method: .version_select at 0x7f7b0120dee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1069479018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvXp71P2npNh2aikBjURY0Y3TJnG9ssjWp8sd74I4WNSj34F10hmblKugBvbHYnBwWG0EMI9DbS8PLJQnkUfSZaMdeq7fPNlnfGCS/xw9ovdbRhSR6k9iNMiXY6uix5OQ=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:43.508369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-936e1e21-ae54-4b6e-ac35-1f7436341f4b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Getting quotas for project 65a7c712ebe34d53b4acd7e8473c6d95. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:18:43.510214 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:43.520996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-936e1e21-ae54-4b6e-ac35-1f7436341f4b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Getting quotas for user 55bc735165cd4029bd5d581fd0187f9b and project 65a7c712ebe34d53b4acd7e8473c6d95. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:18:43.523205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d661cc47-7827-4fe2-887c-203129dedf66 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.245387 Jun 18 05:18:43.531246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 95/210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:43 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:43.541033 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ea356a0b-40e1-48b9-bb13-d28273d0a2a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:43.541712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ea356a0b-40e1-48b9-bb13-d28273d0a2a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:43.601714 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-936e1e21-ae54-4b6e-ac35-1f7436341f4b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.393930 Jun 18 05:18:43.602858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 116/211] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:18:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:43.625503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:43.625503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:43.648546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:43.648980 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.651026 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:43.651444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:43.683186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ea356a0b-40e1-48b9-bb13-d28273d0a2a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:43.691202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ea356a0b-40e1-48b9-bb13-d28273d0a2a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1213 microversion: 2.1 time: 0.158815 Jun 18 05:18:43.692687 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 96/212] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:43 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:43.882592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:43.895158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b254e953-f630-40c0-b925-3865c4d94b89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.277482 Jun 18 05:18:43.900546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 117/213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:43 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:44.225427 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:44.226438 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:44.244348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.244348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.244348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.244348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.402085 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:44.413068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:44.422548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:44.425074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6f8c4481-df0f-4584-a751-04bf667c6897 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1744 microversion: 2.20 time: 0.204050 Jun 18 05:18:44.425934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 97/214] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:44 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:18:44.542936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:44.543665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:44.555117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.555656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.558213 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.558663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.710808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:44.712366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:44.720333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.720877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.721776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.722267 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.756969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:44.777073 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c1bf9dd4-ae9e-4904-bcf3-396850466c3f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.239279 Jun 18 05:18:44.778333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 118/215] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:44 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:44.805494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:44.820101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d5fa158c-89a6-4426-ad9b-4a96f079bc28 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1217 microversion: 2.1 time: 0.114738 Jun 18 05:18:44.826136 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 98/216] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:44 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:44.913989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:44.916898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:44.926864 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.928264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:44.929342 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:44.934973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.133603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:45.145488 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ca50c547-a049-47d1-85a1-b8b6e15322b4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.235132 Jun 18 05:18:45.154874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 119/217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:44 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:45.444956 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:45.445750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:45.454838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:45.457120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.462604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:45.463557 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.680012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:45.689205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:45.690824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:45.695057 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2302d823-20ed-4807-8c80-e3fb55628556 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1744 microversion: 2.20 time: 0.251575 Jun 18 05:18:45.698911 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 99/218] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:45 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:45.795507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:45.796539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:45.803723 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:45.804562 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.805627 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:45.806302 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.842979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:45.844215 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:45.873974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:45.876036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.877285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:45.877420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:45.992822 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:46.008080 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f15bccff-b0ef-4e5b-a31f-7920a9ae8827 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1209 microversion: 2.1 time: 0.166403 Jun 18 05:18:46.009871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 100/219] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:45 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1209 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:46.047370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:46.058055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e121dece-38d7-4e23-8448-00548706cb16 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.267936 Jun 18 05:18:46.059617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 120/220] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:45 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:46.166628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:46.168144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:46.174793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:46.175638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:46.176585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:46.177198 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:46.345848 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:46.354769 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3e0f2d40-2090-4c84-8091-e9a42bd540fd tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.193611 Jun 18 05:18:46.355353 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 101/221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:46 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:46.713086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:46.714027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:46.721167 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:46.721647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:46.722444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:46.722870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:46.819709 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5af658d5-478d-4c5e-8dc3-9f25090d7141 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:46.826988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5af658d5-478d-4c5e-8dc3-9f25090d7141 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:46.827435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5af658d5-478d-4c5e-8dc3-9f25090d7141 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:46.901202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5af658d5-478d-4c5e-8dc3-9f25090d7141 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Going to try to stop instance {{(pid=117990) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 05:18:46.967225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:46.981343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:46.985071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:46.988317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-31edcf29-e386-42ad-8227-40fdfe4f630d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.279780 Jun 18 05:18:46.991153 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 121/222] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:46 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:47.030240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:47.031044 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:47.041396 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.042029 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.042969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.043715 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.120378 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5af658d5-478d-4c5e-8dc3-9f25090d7141 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action" status: 202 len: 0 microversion: 2.1 time: 0.304211 Jun 18 05:18:47.121548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 102/223] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:18:46 2022] POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:18:47.129725 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:47.135397 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:47.149298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.151699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.159755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.160505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.167205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:47.194946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:47.210847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-67ebb41b-7a82-4363-b308-b87c56f25abc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1273 microversion: 2.1 time: 0.185888 Jun 18 05:18:47.216623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 122/224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:47 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:47.227767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:47.247574 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:47.263345 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.263796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.264577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.265015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.481810 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:47.489345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-905b918b-59f5-456a-8887-c79258064f2d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.366289 Jun 18 05:18:47.499424 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 103/225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:47 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:47.504680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:47.510583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:47.512973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.513578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.514525 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:47.514965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:47.659712 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:47.671716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-69ae8837-5acb-4247-b5e6-15601d09dd3e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.453062 Jun 18 05:18:47.683582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 123/226] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:47 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:47.702728 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:47.715396 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2133c423-af58-4049-8f26-45719d310daf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.214261 Jun 18 05:18:47.716698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 104/227] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:47 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:48.011154 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:48.011665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:48.020394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.020842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.023242 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.023678 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.232714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:48.233531 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:48.241191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.241953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.242927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.243513 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.338582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:48.347419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:48.351943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:48.355559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3d3793a0-c345-4f74-bdcd-2fad4d1a1784 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.350304 Jun 18 05:18:48.358984 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 124/228] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:48 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:48.492220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:48.503524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c6784793-b757-4769-a249-92f0e89fae76 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.272089 Jun 18 05:18:48.514104 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 105/229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:48 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:48.514278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:48.514278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:48.514278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.516188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.517122 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.520783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.693420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:48.694484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:48.700248 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:48.704753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.705530 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.706522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.707170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.711340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a448b445-f27f-4ce8-9cf6-a26d5a408f62 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.208780 Jun 18 05:18:48.723521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 125/230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:48 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:48.743115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:48.744452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:48.756188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.756946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.759787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:48.760651 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:48.907898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:48.918724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-36392950-2be5-4f4c-b2e1-1c85a6497e6b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.230521 Jun 18 05:18:48.919670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 106/231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:48 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:49.034836 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:49.050285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a284c6dd-99ea-4c3c-81f6-b14a7efdeab4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.320839 Jun 18 05:18:49.060634 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 126/232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:48 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:49.382685 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:49.384253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:49.392548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.396966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.396966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.396966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.520008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:49.520726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:49.535659 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.536396 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.537350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.537991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.617776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:49.633631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:49.635512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:49.636876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cd498e0a-8fe3-4237-8bce-84f3c75ceb09 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.261740 Jun 18 05:18:49.638270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 107/233] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:49 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:49.731648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:49.733511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:49.755844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.756959 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.759742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.760444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.842936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:49.850873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-80e08001-4f2f-4cc9-bc77-5ac8e7f61c61 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.334575 Jun 18 05:18:49.851882 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 127/234] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:49 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:49.937717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:49.938739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:49.943653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:49.945794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.946550 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.948006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:49.948650 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:49.951705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2385f4c8-1d6b-40eb-8250-eea2e27a41f8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.225180 Jun 18 05:18:49.952672 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 108/235] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:49 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:50.054517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-55fa3d09-9df5-49e1-a424-085f4799df1d req-8e501c60-0410-4176-af67-473f16c4d54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc7d567-b8b5-41bc-959b-b4a4c763c0e5", "tag": "4790ed97-55ad-44c9-b7ba-cf9b8c33f658"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:50.067767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-55fa3d09-9df5-49e1-a424-085f4799df1d req-8e501c60-0410-4176-af67-473f16c4d54b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.068210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-55fa3d09-9df5-49e1-a424-085f4799df1d req-8e501c60-0410-4176-af67-473f16c4d54b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.089593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-55fa3d09-9df5-49e1-a424-085f4799df1d req-8e501c60-0410-4176-af67-473f16c4d54b service nova] Creating event network-changed:4790ed97-55ad-44c9-b7ba-cf9b8c33f658 for instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 on hv-cinder-83699 Jun 18 05:18:50.098379 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-55fa3d09-9df5-49e1-a424-085f4799df1d req-8e501c60-0410-4176-af67-473f16c4d54b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047526 Jun 18 05:18:50.098993 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 109/236] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:50.104518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:50.105226 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:50.112007 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.112696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.113688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.114290 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.269502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:50.282936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-36f6c28a-b641-4e89-befe-c15eb910e6f1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.347516 Jun 18 05:18:50.291903 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 128/237] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:49 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:50.371352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:50.382119 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cef032e9-bc89-49dd-89ee-b7277abd1c73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.281909 Jun 18 05:18:50.383233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 110/238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:50 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:50.664829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:50.669801 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:50.698598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.704962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.707284 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.709244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.723358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:50.868987 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:50.869701 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:50.876547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.885839 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.887064 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:50.887672 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:50.998218 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.010517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.012959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.020644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-23cf8096-d4be-416b-93e7-5eb48f35dd93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.364088 Jun 18 05:18:51.024885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 129/239] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:50 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:51.035303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:51.036417 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:51.071699 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.075016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.076308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.077046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.339877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.355109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4de5e317-1658-44b5-af7f-3a593b58b0f1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.488020 Jun 18 05:18:51.355109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 111/240] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:50 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:51.364293 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:51.366158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:51.377311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.378332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.379324 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.380199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.454682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.463889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e647de16-a060-4bef-9756-f1a294ba3903 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.437479 Jun 18 05:18:51.464798 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 130/241] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:51 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:51.470641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-c021c461-5038-453a-845b-ee169754ae5d req-0a66edfb-a0f6-4946-8b83-8a18a95c7e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "name": "network-vif-plugged", "status": "completed", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:51.480747 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c021c461-5038-453a-845b-ee169754ae5d req-0a66edfb-a0f6-4946-8b83-8a18a95c7e9e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.480937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c021c461-5038-453a-845b-ee169754ae5d req-0a66edfb-a0f6-4946-8b83-8a18a95c7e9e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.499612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-c021c461-5038-453a-845b-ee169754ae5d req-0a66edfb-a0f6-4946-8b83-8a18a95c7e9e service nova] Creating event network-vif-plugged:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:18:51.505032 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-c021c461-5038-453a-845b-ee169754ae5d req-0a66edfb-a0f6-4946-8b83-8a18a95c7e9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038503 Jun 18 05:18:51.507664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 131/242] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:51.513346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:51.514209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:51.522788 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.523239 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.524013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:51.524480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:51.574490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.608280 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6715355d-cf4b-4581-bdb0-1f21d08a814e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.251414 Jun 18 05:18:51.618305 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 112/243] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:51 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:51.873856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:51.903913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-94011fa0-c193-4a3f-8dfb-b268c119c2e7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.396272 Jun 18 05:18:51.914214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 132/244] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:51 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:52.046338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:52.046519 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:52.054886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.055600 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.057645 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.058102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.221285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:52.231741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:52.233319 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:52.234768 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f842f8bc-4bb0-4389-b4bc-24c4b4548844 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.193513 Jun 18 05:18:52.235493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 113/245] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:52 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:52.372748 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:52.373301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:52.379942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.380396 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.381159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.381624 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.481332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:52.482134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:52.489281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.490055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.491179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.491761 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.576792 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:52.595092 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-46eb129b-c881-47cf-8829-48c875c8845a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.226549 Jun 18 05:18:52.610829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 133/246] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:52 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:52.626986 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:52.628920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:52.639931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.640869 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.644462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.645248 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.712485 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:52.733448 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-579a6218-7a56-4c2a-8dbd-f131361f15b5 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.257048 Jun 18 05:18:52.735125 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 114/247] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:52 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:52.871891 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:52.883957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f90e49c1-4fdc-4c9f-be4f-0d744386eb42 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.261051 Jun 18 05:18:52.886908 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 134/248] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:52 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:52.922791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:52.923893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:52.930922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.931601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:52.932926 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:52.933906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.060498 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:53.191601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:53.202239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9cfd61e8-e1fa-4fb7-a676-a82f8375bb51 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.283360 Jun 18 05:18:53.203838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 115/249] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:52 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:53.257058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:53.264861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:53.269781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.271291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.272188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.272964 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.521698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-6e5b48e3-3590-4636-8fbc-cb731f36d52b req-65c8068e-a1d7-4f9b-b806-8f23f1e08a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "name": "network-vif-plugged", "status": "completed", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:53.536658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:53.558844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-6e5b48e3-3590-4636-8fbc-cb731f36d52b req-65c8068e-a1d7-4f9b-b806-8f23f1e08a30 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.559359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-6e5b48e3-3590-4636-8fbc-cb731f36d52b req-65c8068e-a1d7-4f9b-b806-8f23f1e08a30 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.581184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-6e5b48e3-3590-4636-8fbc-cb731f36d52b req-65c8068e-a1d7-4f9b-b806-8f23f1e08a30 service nova] Creating event network-vif-plugged:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:18:53.589996 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-6e5b48e3-3590-4636-8fbc-cb731f36d52b req-65c8068e-a1d7-4f9b-b806-8f23f1e08a30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070876 Jun 18 05:18:53.599006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 116/250] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:18:53.620689 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:53.621803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:53.629279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.630723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.631639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.632181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.699698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=8 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:53.852696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:53.867387 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:53.874950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:53.886573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-25446798-f72a-4fc0-bf47-2dba824b57b8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.625241 Jun 18 05:18:53.886573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 135/251] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:53 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:53.886573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:53.886573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:53.887548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:53.889947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.890586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.891467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.891912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.901455 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ab8aecf9-f8b7-4aa8-b1cc-fd2088617bb0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.286112 Jun 18 05:18:53.902686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 117/252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:53 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:53.907192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:53.911196 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:53.927381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.928121 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:53.929112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:53.929832 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:54.115117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:54.126877 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9de7228e-34b4-4eb7-97c4-a77e61059350 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.248698 Jun 18 05:18:54.128705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 136/253] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:53 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:54.158412 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:54.168754 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-084ed5e3-389b-4a88-bc2f-31985cf5f7fe tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.265039 Jun 18 05:18:54.169896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 118/254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:53 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:54.221443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:54.222055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:54.229796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:54.230405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:54.231405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:54.232129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:54.409138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:54.420139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c8a4135f-d528-4b48-a1a9-bb355da36ce1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.202950 Jun 18 05:18:54.421001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 137/255] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:54 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:54.900144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:54.901440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:54.912495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:54.914845 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:54.921241 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:54.923482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:54.932438 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:54.936368 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:54.952576 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:54.965558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:54.966755 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:54.972313 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.139511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.149697 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.153263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.154632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a18da3e5-936e-44cb-9ac4-1877c98a897e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.263877 Jun 18 05:18:55.157346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 119/256] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:54 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:55.168501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:55.169124 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:55.184420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:55.188333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.189888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:55.190498 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.361002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.369290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4ef6f039-f1bf-4210-aeae-dd8a56e31137 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.448345 Jun 18 05:18:55.388883 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 138/257] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:54 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:55.396501 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:55.397232 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:55.414593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:55.415041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.415816 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:55.417467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.540890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.550915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d698e91e-0c12-4636-9b43-32895b25f54f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1357 microversion: 2.1 time: 0.392389 Jun 18 05:18:55.553867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 120/258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:55 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1357 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:55.561419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:55.565539 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:55.584953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:55.586568 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.587725 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:55.590126 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:55.606529 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:55.705547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.716757 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ec2d8333-8d24-4a56-9b93-e45bf1619593 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.335518 Jun 18 05:18:55.726527 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 139/259] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:55 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:55.805260 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:55.815355 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d258e298-eee7-486e-a1cc-c371ce25f5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.259665 Jun 18 05:18:55.817898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 121/260] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:55 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:56.176232 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:56.189187 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:56.201924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.203638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.204481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.209725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.378880 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:56.387378 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:56.388863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:56.390050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-49bbc9aa-04ec-46a6-82d6-099fd9896674 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.217845 Jun 18 05:18:56.390609 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 140/261] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:56 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:56.396566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:56.398145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:56.404888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.405343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.406161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.406595 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.553430 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:56.561810 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c3e3be3f-cc05-45b7-814a-5489d5b702bf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.169505 Jun 18 05:18:56.567245 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 122/262] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:56 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:56.571626 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:56.572181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:56.580485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.580943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.581750 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.582187 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.734124 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:56.734733 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:56.741994 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.742449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.743236 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.743716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.747855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:56.758286 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-deb3c775-aa77-4c95-8fdc-aaf89d3a0f41 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1546 microversion: 2.1 time: 0.190925 Jun 18 05:18:56.762539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 141/263] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:56 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:56.780041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:56.780041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:56.792290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.797640 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.797640 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.797640 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.948818 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:56.972519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-63a89125-11b9-419f-8dea-7f6521f73a0d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1546 microversion: 2.1 time: 0.199011 Jun 18 05:18:56.973718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 142/264] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:56 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:56.978730 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:56.979681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:56.986867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.987626 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:56.988603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:56.989202 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.026621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.040791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e3757597-8f2f-4bc2-b1f8-6868af8f9050 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.310255 Jun 18 05:18:57.043307 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 123/265] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:56 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:57.053365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:57.063915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.070936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Searching by: {'deleted': False, 'project_id': '3a833f00ba294564a66b9eefbc49147e'} {{(pid=117990) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 05:18:57.083971 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.089756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.091266 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.091791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.171725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.181324 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-80a85a7d-cf76-4688-a38a-72f545d42f9d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.206294 Jun 18 05:18:57.194917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 143/266] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:56 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:57.279581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.multi_cell_list [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117990) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 05:18:57.408849 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:57.411982 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:57.415551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c5434bb5-4a1a-486a-9098-340be027f013 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.365901 Jun 18 05:18:57.416259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 124/267] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Jun 18 05:18:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:57.426706 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.427405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.428561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.428701 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:57.429284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:57.429484 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.443622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.444062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.445468 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.446055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.654096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.671002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.671002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.671002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e9c1e685-53de-4baa-a745-719860473859 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.264868 Jun 18 05:18:57.683588 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 144/268] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:57 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:57.689977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:57.690911 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:57.698598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:57.700149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.700724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.701603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.702231 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.726465 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.738472 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6c6a3641-53b1-447e-b2fe-12962b75f963 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1546 microversion: 2.1 time: 0.314302 Jun 18 05:18:57.751619 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 125/269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:57 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:57.751619 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-d0589e23-837a-4363-b347-59d148684064 req-d28585d0-8f23-4c3d-b10e-913f75a710d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc7d567-b8b5-41bc-959b-b4a4c763c0e5", "name": "network-vif-plugged", "status": "completed", "tag": "4790ed97-55ad-44c9-b7ba-cf9b8c33f658"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:18:57.757292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-d0589e23-837a-4363-b347-59d148684064 req-d28585d0-8f23-4c3d-b10e-913f75a710d0 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:57.757916 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-d0589e23-837a-4363-b347-59d148684064 req-d28585d0-8f23-4c3d-b10e-913f75a710d0 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:57.775171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-d0589e23-837a-4363-b347-59d148684064 req-d28585d0-8f23-4c3d-b10e-913f75a710d0 service nova] Creating event network-vif-plugged:4790ed97-55ad-44c9-b7ba-cf9b8c33f658 for instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 on hv-cinder-83699 Jun 18 05:18:57.785202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-d0589e23-837a-4363-b347-59d148684064 req-d28585d0-8f23-4c3d-b10e-913f75a710d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043406 Jun 18 05:18:57.790675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 126/270] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:18:57.901414 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:57.914769 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-52f35438-ca30-4a02-b052-2725f392f4c4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.229177 Jun 18 05:18:57.924874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 145/271] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:57 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:58.066513 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:58.067309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:58.075333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.075788 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.076570 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.077008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.199695 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:58.200980 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:58.209984 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.210798 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.211814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.212585 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.320381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:58.368248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-01124618-ec8f-439e-961d-b573f35e9f46 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.305067 Jun 18 05:18:58.371659 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 127/272] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:58 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:58.434263 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:18:58.632037 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:58.638188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-dbd4cf46-ec96-49dc-b121-53a1c89a0d89 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.443237 Jun 18 05:18:58.640945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 146/273] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:58 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:18:58.688926 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:58.689506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:58.696566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.697997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.698767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.699203 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.906658 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:58.917276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:58.918938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:58.920123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ad60d1c6-05f8-4d09-a2ae-a785164e7d71 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.235236 Jun 18 05:18:58.921012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 128/274] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:58 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:18:58.932465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:58.937722 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:58.942559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.942947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:58.943793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:58.944184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.126478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:59.136361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8431829c-6544-4023-be18-e96bbe486b31 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1313 microversion: 2.1 time: 0.208075 Jun 18 05:18:59.137423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 147/275] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:58 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:59.394983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:59.394983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:59.411749 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:59.412614 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.415699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:59.418723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.628703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:59.643142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3dcd0400-8905-460c-84b5-6f8dd0f5b99f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.256963 Jun 18 05:18:59.645535 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 129/276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:59 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:18:59.660353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:59.661693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:59.670720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:59.676020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.677604 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:59.678264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.939492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:18:59.940113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:18:59.951482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:59.952507 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.956150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:18:59.960289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:18:59.961885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:18:59.967967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4c85c167-7c91-4764-a070-24034da92988 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.312999 Jun 18 05:18:59.968965 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 148/277] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:18:59 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:00.050660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de11020e-f5e4-4137-9d15-1d1ce1a89cf0"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:00.051779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:00.063502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.063953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.065067 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.065526 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.197212 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:00.209533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:00.211453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:00.212693 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2ca27174-6b28-4d1c-b213-1c10377eb31c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.277643 Jun 18 05:19:00.213861 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 130/278] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:18:59 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:00.218919 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:00.219690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:00.231730 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.232663 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.234581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.235032 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.403132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:00.410906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e09ad11e-9adb-457e-a6a3-fcd05310c408 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1497 microversion: 2.1 time: 0.195918 Jun 18 05:19:00.423051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 131/279] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:00 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:00.662991 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:00.663591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:00.671415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.671863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.672638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.673064 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.842849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:00.850874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-43ec62be-b24d-4cf0-9b1e-d70c3b0e78cf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.191926 Jun 18 05:19:00.851440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 132/280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:00 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:00.985890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:00.986578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:00.993070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.993551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:00.994944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:00.995512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:01.133912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:01.147858 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f2efff78-d5cb-4b7a-8cac-2036133613dc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.163306 Jun 18 05:19:01.147858 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 133/281] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:00 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:01.233401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:01.255477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:01.255477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:01.255477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:01.255477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:01.255909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:01.376880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:01.385359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:01.386892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:01.388130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-42b6fcd2-626f-49ba-8295-feaafe709213 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.160337 Jun 18 05:19:01.388686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 134/282] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:01 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:01.870414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:01.871030 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:01.877735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:01.878177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:01.878947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:01.879380 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:02.042623 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:02.052649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b0c0846b-66b4-4fc6-a03c-a1c98008f3cb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.186914 Jun 18 05:19:02.053229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 135/283] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:01 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:02.163983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:02.164943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:02.172271 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:02.172938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:02.173725 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:02.174368 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:02.314842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:02.322343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c12997a4-1b5a-483b-8b66-6f64abb8bb95 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.162203 Jun 18 05:19:02.322958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 136/284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:02 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:02.408191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:02.408972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:02.411091 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:02.416641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:02.417739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:02.418536 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:02.418986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:02.559714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:02.567738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:02.569264 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:02.570445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-924662fc-4f36-4a27-9c44-4fa26d25eab2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1739 microversion: 2.20 time: 0.166516 Jun 18 05:19:02.571000 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 137/285] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:02 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:03.070710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:03.071391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:03.079392 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.079931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.080820 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.084759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.086521 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:03.228988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:03.238448 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9b805ba1-df47-4b77-a8a2-7b1a09a8a6e3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.171749 Jun 18 05:19:03.239029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 138/286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:03 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:03.339802 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:03.340363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:03.346798 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.347243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.348066 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.348477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.506300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:03.515991 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bd2fa909-65f0-42a4-952a-ce617bc7a10c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.180780 Jun 18 05:19:03.518037 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 139/287] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:03 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:03.523042 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:03.523543 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:03.530223 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.530666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.531435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.532008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.556406 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:19:03.803706 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2d20291c-4b0f-4e9f-894b-309e00f169f7 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 204 len: 0 microversion: 2.1 time: 0.284424 Jun 18 05:19:03.804288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 140/288] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:19:03 2022] DELETE /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:19:03.810084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:03.815458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:03.817358 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.817960 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.818748 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.819180 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.915219 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6140568e-94a2-4d9d-a593-fb11f5f1c598 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.868543 Jun 18 05:19:03.916078 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 149/289] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:19:00 2022] POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments => generated 194 bytes in 3871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:03.922419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:03.924809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:03.930000 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.930515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.931284 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:03.931713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:03.965997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:03.975651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:03.977150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:03.978530 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9279f78d-fffa-4914-bc13-c486f4af4ce0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.173165 Jun 18 05:19:03.979303 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 141/290] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:03 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:04.086969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:04.097166 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-53c73821-bea8-4a8a-ba11-22c0b6d0879a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1503 microversion: 2.1 time: 0.179000 Jun 18 05:19:04.097902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 150/291] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:03 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:04.257287 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:04.257925 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:04.264326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:04.264778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:04.265568 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:04.266006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:04.403041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:04.412731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9b912651-4cee-4b93-b348-903d0c55672e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.159250 Jun 18 05:19:04.413571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 142/292] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:04 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:04.533561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:04.534106 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:04.541230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:04.541907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:04.542693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:04.543124 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:04.682882 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:04.690475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6651134e-1398-4d67-87a5-181f4004bcf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.160877 Jun 18 05:19:04.691050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 151/293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:04 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:04.997508 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:04.998621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:05.005296 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.005801 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.006573 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.007016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.116763 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:05.117397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:05.123874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.124323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.125096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.125584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.140153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:05.148635 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:05.153666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:05.153666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-40b6db76-54dd-48f0-9522-f9eecd89cd6b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.157817 Jun 18 05:19:05.153666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 143/294] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:04 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:05.258778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:05.266724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bb59a8ec-c43d-4018-94a7-70ae6c84d039 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1503 microversion: 2.1 time: 0.153899 Jun 18 05:19:05.267280 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 152/295] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:05 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:05.430304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:05.430913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:05.437791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.438286 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.439092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.439463 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.569040 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:05.577838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ee92a0f6-2353-472c-a947-8059615fc9b0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.151346 Jun 18 05:19:05.578409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 144/296] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:05 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:05.708756 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:05.709367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:05.715824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.716273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.717134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:05.717606 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:05.844701 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:05.852047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b57f1855-a788-4374-9752-8e8df3dd52b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.147196 Jun 18 05:19:05.852601 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 153/297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:05 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:06.173722 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:06.174451 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:06.181133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.181629 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.182796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.183234 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.284299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:06.284907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:06.290889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.291753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.292670 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.292993 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.322814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:06.331573 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:06.333182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:06.334703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-138ad93a-72b8-4adf-89cd-bdbc0460f5a6 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.165670 Jun 18 05:19:06.335266 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 145/298] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:06 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:06.432792 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:06.440292 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6881df2b-2582-496f-82a2-b64976794a07 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1503 microversion: 2.1 time: 0.159911 Jun 18 05:19:06.440851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 154/299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:06 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:06.596345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:06.596879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:06.603742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.604186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.604931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.605357 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.734083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:06.741905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6a32361d-946d-44c8-adad-4e3ade25d571 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.150937 Jun 18 05:19:06.742464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 146/300] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:06 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:06.869705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:06.870232 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:06.877777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.878249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:06.879007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:06.879483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.010619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:07.017282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-62eee1e0-8362-4e4e-a5bd-d1e71a2d7f57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.151651 Jun 18 05:19:07.017872 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 155/301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:06 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:07.353506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:07.354116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:07.356122 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:07.361029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:07.361535 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.366000 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:07.366000 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.457676 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:07.458295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:07.464300 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:07.464751 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.465539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:07.465979 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.496080 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:07.504309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:07.506009 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:07.507170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-39d0340f-0c5d-4b53-a177-1fb3bb6b801f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.157661 Jun 18 05:19:07.507722 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 147/302] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:07 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:07.600008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:07.607403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ca0d1657-d252-49ac-9b5c-b58a007c803a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1503 microversion: 2.1 time: 0.153611 Jun 18 05:19:07.607969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 156/303] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:07 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:07.758420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:07.759023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:07.766168 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:07.766611 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.767361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:07.767790 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:07.898060 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:07.906227 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-93f7fe91-8d89-46de-a3e7-1764c632d946 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.151588 Jun 18 05:19:07.906782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 148/304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:07 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:08.034639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:08.035181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:08.041681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.042130 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.042884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.043313 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.172688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:08.180176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f7105f44-2ba7-43be-a5fc-16e9993cce2e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.149505 Jun 18 05:19:08.184651 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 157/305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:08 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:08.538365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:08.543506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:08.549823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.550466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.552220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.552815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.636002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:08.636002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:08.643158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.643632 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.644427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.644873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.851977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:08.863663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-337f0161-0c49-4d2f-9b89-fe510a5aa8f4 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1503 microversion: 2.1 time: 0.243326 Jun 18 05:19:08.864492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 158/306] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:08 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:08.876337 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:08.886136 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:08.887062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:08.888247 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-946c6fe8-4e27-46ae-8e75-2d7c668a16f5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.365325 Jun 18 05:19:08.888844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 149/307] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:08 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:08.925061 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:08.925716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:08.931625 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.932086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:08.934118 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:08.934118 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.067750 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:09.076591 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c1405570-ecae-435f-8abf-41aa3e1f1053 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.156691 Jun 18 05:19:09.077912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 159/308] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:08 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:09.175863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-4ffec746-36b0-49ee-839f-0ab046c1cb65 req-004886f4-5ea6-4d21-b968-d5b61a7a74a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc7d567-b8b5-41bc-959b-b4a4c763c0e5", "name": "network-vif-deleted", "tag": "4790ed97-55ad-44c9-b7ba-cf9b8c33f658"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:09.184206 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-4ffec746-36b0-49ee-839f-0ab046c1cb65 req-004886f4-5ea6-4d21-b968-d5b61a7a74a5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.184678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-4ffec746-36b0-49ee-839f-0ab046c1cb65 req-004886f4-5ea6-4d21-b968-d5b61a7a74a5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.197103 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-4ffec746-36b0-49ee-839f-0ab046c1cb65 req-004886f4-5ea6-4d21-b968-d5b61a7a74a5 service nova] Creating event network-vif-deleted:4790ed97-55ad-44c9-b7ba-cf9b8c33f658 for instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 on hv-cinder-83699 Jun 18 05:19:09.202856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:09.202856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:09.203083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-4ffec746-36b0-49ee-839f-0ab046c1cb65 req-004886f4-5ea6-4d21-b968-d5b61a7a74a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030281 Jun 18 05:19:09.205536 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 150/309] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:09.205701 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.206590 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.207363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.207805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.350729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-8d211e51-24a2-4bd6-8fba-815fb6b67b64 req-9e92e92c-9064-489d-9589-4ec219aadff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "name": "network-vif-unplugged", "status": "completed", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:09.362806 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8d211e51-24a2-4bd6-8fba-815fb6b67b64 req-9e92e92c-9064-489d-9589-4ec219aadff8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.363277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8d211e51-24a2-4bd6-8fba-815fb6b67b64 req-9e92e92c-9064-489d-9589-4ec219aadff8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.382975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-8d211e51-24a2-4bd6-8fba-815fb6b67b64 req-9e92e92c-9064-489d-9589-4ec219aadff8 service nova] Creating event network-vif-unplugged:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:19:09.391454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-8d211e51-24a2-4bd6-8fba-815fb6b67b64 req-9e92e92c-9064-489d-9589-4ec219aadff8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047033 Jun 18 05:19:09.391454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 151/310] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:09.447120 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:09.455688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-665b94ab-1a2e-4703-b041-a94a8435cbc3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.261496 Jun 18 05:19:09.456388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 160/311] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:09 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:09.882936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:09.884167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:09.891160 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.891593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.892453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.892885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.906758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:09.909769 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:09.913479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.913932 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.914689 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.915123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.925234 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:09.925708 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:09.926154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lazy-loading 'fault' on Instance uuid 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:19:09.972551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:09.980117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-799cf6ae-423d-4e0f-b8c4-d84a23b0c7dd tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1303 microversion: 2.1 time: 0.102562 Jun 18 05:19:09.980759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 152/312] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:09 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:10.050658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:10.054209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:10.058927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:10.060430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:10.064710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-892c1f07-1824-4f05-ab37-35aa75863c37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.159203 Jun 18 05:19:10.064710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 161/313] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:09 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:10.095504 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:10.097297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:10.103327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:10.103770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:10.104563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:10.105037 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:10.240602 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:10.248868 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-22a0e690-482e-442c-adcc-a907254b7210 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.158472 Jun 18 05:19:10.250093 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 153/314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:10 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:10.472340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:10.472971 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:10.479240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:10.479677 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:10.480421 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:10.480855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:10.609825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:10.617331 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c27215a1-0bf4-4b66-b3a1-628104e26474 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.149307 Jun 18 05:19:10.617915 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 162/315] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:10 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:10.997936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:10.998546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:11.005082 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.005548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.006297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.006743 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.010777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:11.037675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.038113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.041454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lazy-loading 'fault' on Instance uuid 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:19:11.078848 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:11.082873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:11.083228 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:11.086674 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-251d2fb6-5ae2-4d7b-9aa6-55af1298fbff tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1303 microversion: 2.1 time: 0.092555 Jun 18 05:19:11.087300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 154/316] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:10 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:11.090615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.093132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.093132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.093132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.231206 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:11.239204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:11.240709 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:11.241894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0b15442b-8857-4f0b-9138-2bf84456951f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.164402 Jun 18 05:19:11.242450 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 163/317] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:11 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:11.267402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:11.268006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:11.274757 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.275207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.275956 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.276387 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.442639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:11.452001 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a568e0b0-786d-40f0-becf-fd08ceb53c10 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.188975 Jun 18 05:19:11.453292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 155/318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:11 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:11.634920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:11.637598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:11.641886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.642335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.643096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:11.643531 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:11.782230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:11.789887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-505d2f4e-f54a-4a37-9e2a-ac95e1d1e8a6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1522 microversion: 2.1 time: 0.158710 Jun 18 05:19:11.800361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 164/319] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:11 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:12.109161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:12.110257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:12.116750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.117184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.127172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.127172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.153228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.153709 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.154157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lazy-loading 'fault' on Instance uuid 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:19:12.225933 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:12.233519 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3b671ccc-c942-4063-8e3c-c001319763aa tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1303 microversion: 2.1 time: 0.128635 Jun 18 05:19:12.234184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 156/320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:12 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:12.260041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:12.260689 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:12.268787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.269233 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.270412 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.270990 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.462703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:12.477782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:12.478782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:12.486762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:12.487064 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.487580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.488535 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.491674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:12.493916 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c8006447-f64c-49d9-9056-f91b24b590b7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1721 microversion: 2.20 time: 0.237027 Jun 18 05:19:12.493916 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 165/321] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:12 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:12.501083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.657628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:12.665993 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-67340332-d53c-4774-ab20-19af47c871a5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.199386 Jun 18 05:19:12.666572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 157/322] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:12 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:12.808866 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:12.809521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:12.816956 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.819725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:12.819725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:12.819725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.038315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:13.050099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-67b97922-afb7-4813-9f71-a71288fa965c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1502 microversion: 2.1 time: 0.246720 Jun 18 05:19:13.050682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 166/323] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:12 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:13.068680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:13.069296 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:13.079740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.083243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.083243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.083243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.228151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:13.236854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4ba442a5-7eaa-4105-96e6-dc033e5f075a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1514 microversion: 2.1 time: 0.173816 Jun 18 05:19:13.237640 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 158/324] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:13 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:13.250681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:13.257768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:13.271559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.272669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.273828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.274268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.312188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.313358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.319879 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lazy-loading 'fault' on Instance uuid 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:19:13.362769 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:13.371211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e76c1394-0700-44a1-9a47-4737df5edebb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 200 len: 1303 microversion: 2.1 time: 0.124488 Jun 18 05:19:13.371795 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 167/325] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:13 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:13.511951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:13.512568 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:13.519601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.520051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.520817 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.521251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.644028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1993903070", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1069479018", "security_groups": [{"name": "tempest-secgroup-smoke-587035780"}], "networks": [{"uuid": "cce77fdc-391d-4bde-a709-4c5e4b2c55d4"}], "block_device_mapping_v2": [{"uuid": "a3aae57d-0e71-4886-8710-02826508fcbe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:13.919647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:13.930102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:13.931619 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:13.932796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-643e78ee-593b-4d2c-80fe-9fef1333d7e3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1724 microversion: 2.20 time: 0.424804 Jun 18 05:19:13.933358 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 159/326] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:13 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:13.938944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:13.939543 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:13.945393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.945852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:13.946804 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:13.947262 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:14.023574 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] validate_networks() for [('cce77fdc-391d-4bde-a709-4c5e4b2c55d4', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:19:14.086857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:14.095109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8652abf3-4dcc-46f4-bad1-1a1c66a8a7bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.160565 Jun 18 05:19:14.102621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 160/327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:13 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:14.102621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "530eb45d-703c-4532-ba98-7ca49f733b33"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:14.102621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:14.107475 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:14.107927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:14.109291 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:14.109759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:14.409596 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:19:14.410090 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:19:14.410635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:19:14.411116 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:19:14.411598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:19:14.423230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:14.425885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:14.425885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:14.425885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:14.442480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Getting quotas for project 65a7c712ebe34d53b4acd7e8473c6d95. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:19:14.446487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Getting quotas for user 55bc735165cd4029bd5d581fd0187f9b and project 65a7c712ebe34d53b4acd7e8473c6d95. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:19:14.514786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:19:14.519252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3aae57d-0e71-4886-8710-02826508fcbe',volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:19:14.971007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2b9b0f13-742d-4eb5-9fd1-25d8f3744972 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.333660 Jun 18 05:19:14.971662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 168/328] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:19:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 05:19:14.976095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:14.976752 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:14.983441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:14.984583 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:14.985519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:14.985946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.004775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] HTTP exception thrown: Instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 could not be found. Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Request method failure captured: Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 HTTP/1.1 Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWAojug3A6dfwDDT3q29-45M_ZDsYshylrl12iD4KNMFzmOp2lu1RbbJSolH80FA1sk_c6slnjZHaeSW6uCnilwvwx6yYcC_1vmsRtTtA4hskw86H2JQr-HKTuZWdjh4CI1ciqaByeqZhAAOVoe4cH8MA4QpoQcw3iJHt-sIVBGs3dE Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: a63728833c434410864d0d7431a9fac2 Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesActionsTest-198952152 Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:19:15.006461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a63728833c434410864d0d7431a9fac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a63728833c434410864d0d7431a9fac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a63728833c434410864d0d7431a9fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a63728833c434410864d0d7431a9fac2"}]}] Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesActionsTest-198952152 Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: a63728833c434410864d0d7431a9fac2 Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesActionsTest-198952152 Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesActionsTest-198952152-project Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 4147695d07c24202b096fb7da07ecf37 Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesActionsTest-198952152-project Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 could not be found. Jun 18 05:19:15.007945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '0dc7d567-b8b5-41bc-959b-b4a4c763c0e5'} Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 could not be found. Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:19:15.008716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 could not be found. Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 could not be found. Jun 18 05:19:15.010139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:15.011388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Returning 404 to user: Instance 0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:19:15.011388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8baf81ad-4df6-489f-9b8b-cd118909bddf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5" status: 404 len: 111 microversion: 2.1 time: 0.035322 Jun 18 05:19:15.011388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 169/329] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:14 2022] GET /compute/v2.1/servers/0dc7d567-b8b5-41bc-959b-b4a4c763c0e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:19:15.014363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0d66db86-f503-47cb-a759-9b75b86f7f82 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:15.014976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0d66db86-f503-47cb-a759-9b75b86f7f82 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:15.097865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0d66db86-f503-47cb-a759-9b75b86f7f82 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:15.107420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0d66db86-f503-47cb-a759-9b75b86f7f82 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1089 microversion: 2.1 time: 0.097884 Jun 18 05:19:15.108442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 170/330] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:15 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1089 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:15.115207 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:15.116751 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:15.125066 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.125627 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.126329 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.126768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.150515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'flavor' on Instance uuid 73b2fdbe-e24f-4092-bf52-db5c0a24f250 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:19:15.179879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a1687a55-05aa-49fc-bc3d-1e5dfe7634cc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.083145 Jun 18 05:19:15.180566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 161/331] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Jun 18 05:19:14 2022] POST /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments => generated 188 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:19:15.185361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:15.186191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:15.193655 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.194297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.196689 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.197154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.339252 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:15.347788 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-54767a53-f375-4105-90a3-2613514565cd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.166181 Jun 18 05:19:15.348332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 162/332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:15 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:15.352717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1883770938", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "networks": [{"uuid": "4041b16e-d0bc-408d-92a3-b2c03aff6ddd"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:15.403277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] validate_networks() for [('4041b16e-d0bc-408d-92a3-b2c03aff6ddd', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:19:15.436698 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3e79606c-0b12-43ce-a920-708c9067a925 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/action" status: 200 len: 32 microversion: 2.1 time: 0.325553 Jun 18 05:19:15.437836 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 171/333] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:19:15 2022] POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:19:15.442570 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:15.443240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:15.449453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.449900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.450656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.451080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.697436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ad87db98-ada5-4cda-889c-65b6abc9fecd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/action" status: 202 len: 0 microversion: 2.20 time: 0.258863 Jun 18 05:19:15.698051 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 172/334] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 05:19:15 2022] POST /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:19:15.703284 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:15.703746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:15.709923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.710572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.711348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.711784 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.792051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:19:15.792463 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:19:15.792928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:19:15.793324 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:19:15.795421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:19:15.807156 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.807649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.808582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.809037 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.830177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Getting quotas for project a63728833c434410864d0d7431a9fac2. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:19:15.835264 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Getting quotas for user 4147695d07c24202b096fb7da07ecf37 and project a63728833c434410864d0d7431a9fac2. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:19:15.855007 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:19:15.857306 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:19:15.877864 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:15.886069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-17ed84f4-7af1-47fe-9589-1c73c055a885 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.186848 Jun 18 05:19:15.886681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 173/335] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:15 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:15.901480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:15.902079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:15.908858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.909397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.910178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:15.910620 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:15.974863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b1bb014f-923c-4b49-b62d-69f0d34f7e22 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625500 Jun 18 05:19:15.975869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 163/336] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:19:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:19:15.987241 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-70c99992-9cdc-4da3-999a-f33121c8cc73 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:15.988166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-70c99992-9cdc-4da3-999a-f33121c8cc73 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:16.055947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-70c99992-9cdc-4da3-999a-f33121c8cc73 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:16.063580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-70c99992-9cdc-4da3-999a-f33121c8cc73 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1214 microversion: 2.1 time: 0.081591 Jun 18 05:19:16.064829 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 164/337] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:15 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:16.081444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:16.090821 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:16.093577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:16.095159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-dc7129d7-c700-41bb-988e-30ad55bf2f96 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1750 microversion: 2.20 time: 0.197446 Jun 18 05:19:16.095932 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 174/338] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:15 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:16.125617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:16.126258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:16.135218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:16.135845 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:16.137051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:16.137677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:16.211260 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:16.220843 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0f742f15-07bf-4e8a-8384-fbd5bfe8996d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1139 microversion: 2.1 time: 0.099504 Jun 18 05:19:16.225022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 165/339] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:16 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:16.365914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:16.366527 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:16.372941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:16.373667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:16.375050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:16.375522 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:16.523217 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:16.532604 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-64dc21b4-947c-41ac-9224-cd3904df7d9d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.170636 Jun 18 05:19:16.533184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 175/340] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:16 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:16.904789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:16.905906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:16.912048 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:16.912490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:16.913249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:16.913735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.051713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.059254 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a3392519-a0b4-468f-8caf-bb5eb58f8e23 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.158862 Jun 18 05:19:17.059809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 166/341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:16 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:17.080631 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:17.081243 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:17.087159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.087602 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.088354 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.088787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.113687 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:17.114296 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:17.120194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.120641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.121416 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.121854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.153762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.161660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5dfa36de-d709-4895-bb13-7618c9aa9a81 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1218 microversion: 2.1 time: 0.085379 Jun 18 05:19:17.162364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 176/342] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:17 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:17.239165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:17.239769 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:17.245783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.246467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.247295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.247715 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.256996 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.267081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:17.267666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.269257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.270576 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6791a540-7cc5-4dfb-b576-83172577b8ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1750 microversion: 2.20 time: 0.160794 Jun 18 05:19:17.271441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 167/343] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:17 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:17.308824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.316644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9b804b4d-3586-4ea0-a444-1959f4d69e54 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1139 microversion: 2.1 time: 0.081369 Jun 18 05:19:17.317221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 177/344] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:17 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:17.550432 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:17.551037 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:17.556990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.557469 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.558249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:17.558682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:17.690710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:17.698620 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-78e39ccb-5188-4a87-a3bf-f49a48a673de tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.152294 Jun 18 05:19:17.699179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 168/345] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:17 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:18.078251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:18.078922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:18.085547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.085991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.086749 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.087177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.178871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:18.179486 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:18.187123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.187900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.188854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.189511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.193827 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:18.225125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.232771 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b62be1d4-418d-4f7d-8199-9c7079d2f49a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.159493 Jun 18 05:19:18.233341 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 178/346] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:18 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:18.263574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.271479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b09a148b-4292-4004-801b-850713788ff3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1218 microversion: 2.1 time: 0.096810 Jun 18 05:19:18.272038 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 169/347] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:18 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:18.288992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:18.289623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:18.295636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.296089 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.297024 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.297488 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.334739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:18.335272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:18.341710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.342155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.343357 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.344019 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.405925 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.413777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2e97cf39-c0a2-465a-95af-b5f9f0928335 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1139 microversion: 2.1 time: 0.083210 Jun 18 05:19:18.414428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 170/348] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:18 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:18.428720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.437829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.439348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.440536 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9f318443-7c2d-43eb-a5d3-82b6761716ea tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1750 microversion: 2.20 time: 0.155374 Jun 18 05:19:18.441100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 179/349] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:18 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:18.716309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:18.716922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:18.722988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.723437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.724195 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:18.724627 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:18.859789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:18.867723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a6608ec4-5ff8-43dc-a61a-388e1c8955f0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.155275 Jun 18 05:19:18.868288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 171/350] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:18 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:19.249172 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:19.250057 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:19.256564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.257008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.257802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.258275 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.287908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:19.288514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:19.295419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.295895 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.297300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.297754 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.367398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:19.375167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-40be41f7-2fc5-41ca-a4d2-d19962984ebe tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1218 microversion: 2.1 time: 0.091122 Jun 18 05:19:19.376505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 172/351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:19 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:19.404126 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:19.412545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-45d3e6ed-1c80-4262-9f60-095ded3ae453 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.167054 Jun 18 05:19:19.413113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 180/352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:19 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:19.431552 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:19.432293 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:19.436113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:19.444579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.444579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.444579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.444579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.459574 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:19.460176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:19.467018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.467581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.470867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.470867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.509734 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:19.518571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-df0319ad-933b-4276-b817-6e0bbd9a96d0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1139 microversion: 2.1 time: 0.091984 Jun 18 05:19:19.519157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 173/353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:19 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:19.600012 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:19.609161 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:19.610803 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:19.612015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b372ffd0-f31c-4e8f-a2c4-daa295be08f8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1750 microversion: 2.20 time: 0.156576 Jun 18 05:19:19.612580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 181/354] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:19 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:19.886360 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:19.886963 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:19.893537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.893981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:19.896742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:19.896742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.028986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.037348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4ef9e1d1-6cc8-4a69-894e-b407dfa8ff87 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1722 microversion: 2.1 time: 0.155329 Jun 18 05:19:20.037936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 174/355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:19 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:20.397957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:20.398568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:20.404999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.406426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.407193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.407781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.428739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:20.429476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:20.437419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.438295 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.439563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.440082 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.470224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.478396 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-092f713d-7017-438f-a479-e9d1ab40f005 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1218 microversion: 2.1 time: 0.084014 Jun 18 05:19:20.478991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 182/356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:20 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:20.537426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:20.538319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:20.546797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.546797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.546797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.546797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.610328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.618054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.618242 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-345fa5e6-7e02-4bb0-86ec-7e2000e68104 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1139 microversion: 2.1 time: 0.085782 Jun 18 05:19:20.618672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 183/357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:20 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:20.628916 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e408aa35-72e4-4c81-b52a-2efab46b6b39 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.204002 Jun 18 05:19:20.636257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 175/358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:20 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:20.641433 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:20.642050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:20.643896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:20.649103 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.649523 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.650281 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:20.650748 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:20.789520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.798762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.800280 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:20.801524 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-90a5def7-fe62-497b-9b88-5dddca77cfbc tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1752 microversion: 2.20 time: 0.164930 Jun 18 05:19:20.804867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 184/359] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:20 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:21.054390 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:21.055095 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:21.062690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.063466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.064584 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.066930 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.217207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:21.226137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fbd6b14f-a09d-432b-a976-d4ff8de884e0 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1699 microversion: 2.1 time: 0.175542 Jun 18 05:19:21.226717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 176/360] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:21 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:21.248035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fb7d2ef1-17c2-4f0a-90ac-178bab89b06d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:21.254704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fb7d2ef1-17c2-4f0a-90ac-178bab89b06d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.255142 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fb7d2ef1-17c2-4f0a-90ac-178bab89b06d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.315014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fb7d2ef1-17c2-4f0a-90ac-178bab89b06d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Going to try to start instance {{(pid=117991) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 05:19:21.495128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:21.495835 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:21.502072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.502536 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.503297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.503775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.550184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fb7d2ef1-17c2-4f0a-90ac-178bab89b06d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action" status: 202 len: 0 microversion: 2.1 time: 0.305863 Jun 18 05:19:21.553638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 185/361] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:19:21 2022] POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:19:21.558849 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:21.559608 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:21.566547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.566994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.567145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:21.567755 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.568184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.575783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d2f24693-2770-48bc-839b-fb3a0884a16a tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1266 microversion: 2.1 time: 0.084502 Jun 18 05:19:21.576367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 177/362] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:21 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:21.636068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:21.636708 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:21.643488 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.643935 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.644694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.645123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.700815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:21.705944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:21.709481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f81280ad-f4c6-41f4-8234-7bca9024e0c8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1708 microversion: 2.1 time: 0.154509 Jun 18 05:19:21.710053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 186/363] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:21 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:21.713249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ee256e1b-3bfb-429a-9bc0-0a75e02c363f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1187 microversion: 2.1 time: 0.081101 Jun 18 05:19:21.713833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 178/364] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:21 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1187 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:21.722817 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:21.723451 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:21.730565 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.731013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.731766 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.732194 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.821560 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:21.822770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:21.828896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.829464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.830477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:21.830972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:21.936419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:21.945260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2e931347-d03e-429e-8bb4-ebc479537946 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.226591 Jun 18 05:19:21.945888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 187/365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:21 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:21.987289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:22.004476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:22.006186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:22.007358 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9b75476e-eb33-4ce3-a76b-bb052b39a8b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1752 microversion: 2.20 time: 0.189908 Jun 18 05:19:22.013791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 179/366] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:21 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:22.115972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:22.116848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:22.123086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.123530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.124304 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.124736 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.341007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:22.351465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1ad864cb-168b-4009-849d-cd2bc8db0aea tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1592 microversion: 2.1 time: 0.239967 Jun 18 05:19:22.368016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 188/367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:22 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1592 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:22.597922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:22.599323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:22.607570 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.608423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.609994 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.610653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.727834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:22.729512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:22.735766 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:22.744903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-653812b7-d378-4bef-adee-14410f5e0a87 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1284 microversion: 2.1 time: 0.154489 Jun 18 05:19:22.747827 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 180/368] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:22 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:22.753903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:22.755209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.755821 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.756750 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.757338 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.760788 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:22.775620 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.776426 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.777617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.778703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.896419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:22.905888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3725a5bc-602c-4bfd-b9e3-c1314d9541ca tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1195 microversion: 2.1 time: 0.156678 Jun 18 05:19:22.908194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 181/369] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:22 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1195 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:22.964676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:22.966491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:22.983624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.984100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:22.993030 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:22.995607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:23.338991 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:23.350808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-860612c1-a2fc-4f82-93f6-2be873d6a24e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.392138 Jun 18 05:19:23.361537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 182/370] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:22 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:23.368466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:23.369196 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:23.381806 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:23.385194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:23.385194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:23.385194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:23.393148 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:23.403483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cb2164bc-9383-424d-867f-6eb2e8aa8135 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1708 microversion: 2.1 time: 0.679725 Jun 18 05:19:23.404071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 189/371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:22 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1708 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:23.670090 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:23.686484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:23.688570 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:23.689815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4b77ef62-b38c-4ba6-aa4e-7e98082c0246 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1752 microversion: 2.20 time: 0.326872 Jun 18 05:19:23.690388 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 183/372] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:23 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1752 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:23.770558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:23.771545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:23.778430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:23.778878 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:23.779641 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:23.780077 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:23.924449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:23.925569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:23.946867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:23.947325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:23.948538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:23.965697 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.143967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.154445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e6fd4562-91cd-47c4-b0f9-966313c132c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1272 microversion: 2.1 time: 0.235622 Jun 18 05:19:24.155472 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 184/373] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:23 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:24.179337 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.187399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a61c3985-6c91-4f47-8bb7-82611f7de915 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.422545 Jun 18 05:19:24.187976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 190/374] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:23 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:24.368240 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:24.368772 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:24.375185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:24.375637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.376410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:24.376847 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.422419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:24.423024 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:24.429022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:24.429494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.430428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:24.431021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.436385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:24.523547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.527289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:24.532707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-32af5ebd-aab9-4197-a79e-512b34a879e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.168432 Jun 18 05:19:24.533293 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 185/375] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:24 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:24.614913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.622886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b13ee0e9-9cc1-4180-85ff-20339a33117c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1708 microversion: 2.1 time: 0.205017 Jun 18 05:19:24.623389 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 191/376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:24 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1708 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:24.709139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:24.709772 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:24.716301 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:24.716746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.717529 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:24.717965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:24.849456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.857742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.859464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:24.860631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0d18dee8-9fd5-4ed4-a336-fe6d1b6f13d9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.155847 Jun 18 05:19:24.861299 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 186/377] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:24 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:25.172192 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:25.172923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:25.175476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=8 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:25.180537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.181075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.181907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.182389 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.208738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:25.210008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:25.218369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.219118 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.219986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.220428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.358515 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:25.366622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b3dfa774-a3cd-4075-8a24-a386befabdf0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.162866 Jun 18 05:19:25.367220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 187/378] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:25 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:25.387327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:25.396677 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-322b4a47-9821-4ec1-a187-100eac1a4381 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1272 microversion: 2.1 time: 0.228429 Jun 18 05:19:25.397245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 192/379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:25 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:25.549617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:25.550399 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:25.556768 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.557419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.558286 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.559051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.573340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-5e02e393-7446-4f1f-9155-acdca5fbc660 req-bf3046d0-94b7-4391-8e04-38331bb1941c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:25.593992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-5e02e393-7446-4f1f-9155-acdca5fbc660 req-bf3046d0-94b7-4391-8e04-38331bb1941c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.595865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-5e02e393-7446-4f1f-9155-acdca5fbc660 req-bf3046d0-94b7-4391-8e04-38331bb1941c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.598870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:25.609834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-5e02e393-7446-4f1f-9155-acdca5fbc660 req-bf3046d0-94b7-4391-8e04-38331bb1941c service nova] Creating event network-changed:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:19:25.615187 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-5e02e393-7446-4f1f-9155-acdca5fbc660 req-bf3046d0-94b7-4391-8e04-38331bb1941c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045624 Jun 18 05:19:25.615861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 193/380] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:25.641554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:25.642268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:25.648819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.649542 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.650518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.650970 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.738754 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:25.747737 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-18ac0465-0036-4c1d-875f-42db13cc92b0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.202230 Jun 18 05:19:25.761223 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 188/381] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:25 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:25.824442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:25.832803 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f659b490-f95b-4946-91db-249801218d15 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1708 microversion: 2.1 time: 0.196262 Jun 18 05:19:25.833422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 194/382] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:25 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1708 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:25.875665 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:25.879968 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:25.880582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:25.886792 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.887336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:25.888112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:25.888547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.031554 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:26.040536 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:26.042327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:26.043744 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-edbe3cf2-e3cf-47d6-90e2-6668afff7293 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.168843 Jun 18 05:19:26.055534 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 189/383] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:25 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:26.383632 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:26.384338 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:26.396743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.397199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.398007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.398611 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.414452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:26.418840 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:26.424307 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=8 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:26.426691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.427239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.428114 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.428647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.550076 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:26.558418 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-741f9971-3031-4838-8d5d-76ca82d143ae tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.178833 Jun 18 05:19:26.568388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 195/384] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:26 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:26.619187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:26.632280 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a419e936-82a5-4c50-94f5-9efaef238d48 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1272 microversion: 2.1 time: 0.221697 Jun 18 05:19:26.632895 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 190/385] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:26 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:26.767624 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:26.770714 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:26.775891 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.776613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.777721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.779390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.851371 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:26.852749 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:26.861316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.862112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:26.863054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:26.863766 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.010474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.021295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7f186ecf-1c2b-4f49-b381-3a15a7a8b132 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.257676 Jun 18 05:19:27.021295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 196/386] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:26 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:27.064018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:27.064904 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:27.071457 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:27.071896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.073068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:27.073688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.165623 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.176556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-00f56819-dc3b-4ff0-98ce-3053c4a0d48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1708 microversion: 2.1 time: 0.328889 Jun 18 05:19:27.187815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 191/387] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:26 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1708 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:27.323064 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.349996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.351682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.353986 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8ba36b4d-62dc-46d5-b722-f938c86c1d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.293950 Jun 18 05:19:27.354672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 197/388] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:27 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:27.579362 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:27.580844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:27.598230 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:27.598943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.600011 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:27.600446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.650006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:27.650788 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:27.659270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:27.660196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.661151 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:27.661802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:27.851569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.868180 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0a4ed7a5-bca7-4576-9e4a-557ce1ec9841 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.295420 Jun 18 05:19:27.876045 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 192/389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:27 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:27.927240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:27.943092 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-655bf5be-4882-4b87-8153-3c4fb3d1ffe2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1272 microversion: 2.1 time: 0.296691 Jun 18 05:19:27.956739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 198/390] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:27 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:28.037127 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:28.037774 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:28.054577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-e6b3e230-2367-4ea7-87d6-d2dce5d63dcd req-4f07d968-cfe8-4b2a-a00a-abfbde1a2de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a0202f-1150-49ed-a508-fbba8692b1d7", "tag": "451c6eb3-9c80-4e4a-8271-8a7ff22fcc68"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:28.084755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.085295 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.086143 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.086587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.091437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-e6b3e230-2367-4ea7-87d6-d2dce5d63dcd req-4f07d968-cfe8-4b2a-a00a-abfbde1a2de4 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.091968 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-e6b3e230-2367-4ea7-87d6-d2dce5d63dcd req-4f07d968-cfe8-4b2a-a00a-abfbde1a2de4 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.117491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-e6b3e230-2367-4ea7-87d6-d2dce5d63dcd req-4f07d968-cfe8-4b2a-a00a-abfbde1a2de4 service nova] Creating event network-changed:451c6eb3-9c80-4e4a-8271-8a7ff22fcc68 for instance 17a0202f-1150-49ed-a508-fbba8692b1d7 on hv-cinder-83699 Jun 18 05:19:28.132113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-e6b3e230-2367-4ea7-87d6-d2dce5d63dcd req-4f07d968-cfe8-4b2a-a00a-abfbde1a2de4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089257 Jun 18 05:19:28.137478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 199/391] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:28.193946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:28.194646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:28.201236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.205287 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.206140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.206571 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.371221 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:28.382609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-495f668e-f6da-4f0f-ba34-09dcf83cbc0f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.349154 Jun 18 05:19:28.384059 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 193/392] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:28 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:28.390642 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:28.391520 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:28.413166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.414054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.415059 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.416054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.676134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:28.685282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c04c2292-4683-41d4-8778-08288ecc8487 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1712 microversion: 2.1 time: 0.495592 Jun 18 05:19:28.688965 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 200/393] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:28 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1712 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:28.700054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-7df10b95-c2c3-40b2-a88f-596271810eab req-79d0eb9b-f72b-45ac-ac5b-cbddb2be62ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:28.720477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-7df10b95-c2c3-40b2-a88f-596271810eab req-79d0eb9b-f72b-45ac-ac5b-cbddb2be62ac service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.720918 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-7df10b95-c2c3-40b2-a88f-596271810eab req-79d0eb9b-f72b-45ac-ac5b-cbddb2be62ac service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.743941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:28.745869 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-7df10b95-c2c3-40b2-a88f-596271810eab req-79d0eb9b-f72b-45ac-ac5b-cbddb2be62ac service nova] Creating event network-changed:2e6ea935-169b-426c-bf26-11d644b1d476 for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b on hv-cinder-83699 Jun 18 05:19:28.752444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-7df10b95-c2c3-40b2-a88f-596271810eab req-79d0eb9b-f72b-45ac-ac5b-cbddb2be62ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060738 Jun 18 05:19:28.757335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 201/394] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:28.757762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:28.757762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:28.758299 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-aacd70b6-66bb-4e0f-b6d4-9d10d80af0f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.372857 Jun 18 05:19:28.759115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 194/395] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:28 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:28.894297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:28.894297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:28.901906 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.906028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.907756 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.908214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.960524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:28.961135 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:28.967813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.968538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:28.969560 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:28.970151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.158566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:29.168014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9b78f763-320a-4d8c-891b-8f5a81304e95 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.285282 Jun 18 05:19:29.168822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 202/396] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:28 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:29.246055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:29.256253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9e3e2c39-87e5-4017-aa0b-04006c5ef83b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.299600 Jun 18 05:19:29.256830 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 195/397] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:28 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:29.399789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:29.400694 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:29.418453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:29.419225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.420217 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:29.421037 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.600170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1758100460"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:29.600881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:29.607901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:29.608781 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.609824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:29.610458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.667481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:29.675442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e574057b-9005-4c88-ad7d-0b011d0e498c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.279365 Jun 18 05:19:29.685007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 203/398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:29 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:29.776591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.network.security_group_api [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Adding security group 131710a9-3157-4597-bd4b-a4a60c8f2d5b to port ed5753b8-9359-4e81-8f42-c2dd469ec79e Jun 18 05:19:29.776890 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:29.777545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:29.784668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:29.785182 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.786018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:29.786506 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:29.941482 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:29.958921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:29.965365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:29.969632 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b9dec50b-a10c-486e-b52f-072e2f5c5a7d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.195931 Jun 18 05:19:29.972534 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 204/399] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:29 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:30.189581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:30.191220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:30.200276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.200913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.202052 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.203534 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.358264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:30.370590 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-425e6fe3-bc03-4ce3-84af-573c1eb32f2c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.188658 Jun 18 05:19:30.381411 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 205/400] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:30 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:30.398922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:30.400382 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:30.408876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.408876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.409409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.409862 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.436100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-7b3375a8-b297-411f-b588-27070cc86c9f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/action" status: 202 len: 0 microversion: 2.1 time: 0.840851 Jun 18 05:19:30.437650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 196/401] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:19:29 2022] POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:19:30.445066 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:30.445822 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:30.459670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.463842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.463842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.463842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.704861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:30.716951 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-321564bf-54d9-4eed-ab83-68f54754c084 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.334081 Jun 18 05:19:30.717767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 206/402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:30 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:30.761705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:30.762476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:30.779693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.783365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.785178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:30.785630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.787548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.799943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f6b709c6-973b-4864-96da-cfb884f9e310 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1757 microversion: 2.1 time: 0.358044 Jun 18 05:19:30.800900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 197/403] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:30 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1757 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:30.820350 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-401c5859-5bcf-4f2f-87a4-2c215fa20be3 req-99311731-0cee-4ee0-9d23-7b48aea9bd1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:30.837174 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-401c5859-5bcf-4f2f-87a4-2c215fa20be3 req-99311731-0cee-4ee0-9d23-7b48aea9bd1c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:30.839703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-401c5859-5bcf-4f2f-87a4-2c215fa20be3 req-99311731-0cee-4ee0-9d23-7b48aea9bd1c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:30.867370 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-401c5859-5bcf-4f2f-87a4-2c215fa20be3 req-99311731-0cee-4ee0-9d23-7b48aea9bd1c service nova] Creating event network-changed:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:19:30.875782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-401c5859-5bcf-4f2f-87a4-2c215fa20be3 req-99311731-0cee-4ee0-9d23-7b48aea9bd1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058884 Jun 18 05:19:30.876556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 198/404] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:30.997436 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:31.000520 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:31.011655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:31.015978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:31.017737 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:31.019997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:31.020849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:31.022656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-331dab8a-2a97-44cc-ba59-9863ec98e4a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.301316 Jun 18 05:19:31.022656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 207/405] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:30 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:31.303637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:31.314505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:31.316815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:31.318450 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-15531451-70af-4c51-8eb7-20f4a85fda37 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.329718 Jun 18 05:19:31.330666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 199/406] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:30 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:31.396222 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:31.397040 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:31.404043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:31.404701 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:31.405838 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:31.406436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:31.565751 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:31.573839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a899884e-cd3c-4ce6-8dd7-f6dccbd69d9f tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.189281 Jun 18 05:19:31.574415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 208/407] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:31 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:31.734605 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:31.735867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:31.742821 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:31.743270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:31.744048 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:31.744486 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:31.904381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:31.922592 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c9d9562a-e9e8-47e9-9054-390afafd2788 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.191895 Jun 18 05:19:31.923406 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 200/408] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:31 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:32.040086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:32.041490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:32.050169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.051131 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.052285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.053121 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.211008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:32.219679 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-029fba2f-1388-48b4-a833-4837ab9add7d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.184158 Jun 18 05:19:32.220249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 209/409] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:32 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:32.336730 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:32.337456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:32.345625 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.346074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.346847 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.347279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.492669 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:32.502541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:32.504126 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:32.505289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-797fcec4-ec6a-454b-8759-1b7b282d0e3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.172447 Jun 18 05:19:32.505897 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 201/410] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:32 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:32.592074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:32.594804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:32.605573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.605573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.605573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.605573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.776582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:32.786681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a4e50901-24f6-4472-9c31-ef1164ed9cec tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.199503 Jun 18 05:19:32.787267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 210/411] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:32 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:32.940072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:32.940680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:32.946741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.947186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:32.947958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:32.948389 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:33.103862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:33.111936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-897df68b-78e8-4189-9b34-36c8198e2fe4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.176208 Jun 18 05:19:33.112537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 202/412] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:32 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:33.237470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:33.238110 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:33.244781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:33.245275 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:33.246302 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:33.246732 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:33.401610 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:33.405407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:33.410216 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f8f444f8-db3c-43c6-a71a-e1a309e66f5d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.177803 Jun 18 05:19:33.410782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 211/413] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:33 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:33.524087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:33.524696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:33.532244 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:33.532787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:33.533518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:33.533985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:33.555955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:33.683610 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:33.713463 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:33.715517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:33.716880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6bf7636e-c575-4817-a195-16b7265fcf48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.196712 Jun 18 05:19:33.717896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 203/414] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:33 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:33.804979 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:33.805965 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:33.815294 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:33.815745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:33.816616 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:33.817064 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.003307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:34.018151 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3b69173e-a012-45b5-b290-6195edd8ebbb tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.217791 Jun 18 05:19:34.021408 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 212/415] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:33 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:34.130332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:34.131717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:34.138200 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:34.138760 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.139585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:34.140625 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.295594 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:34.304774 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-965039c3-bc50-4220-8b87-37c74543a9b2 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.178452 Jun 18 05:19:34.315165 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 204/416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:34 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:34.427658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:34.428944 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:34.435746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:34.436483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.437664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:34.438100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.602311 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:34.606860 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-331079e2-1e49-4319-bdf0-cb13e08a5205 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.182962 Jun 18 05:19:34.607178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 213/417] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:34 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:34.740068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:34.741309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:34.749923 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:34.751251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.752213 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:34.752650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:34.894068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:34.904368 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:34.906471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:34.907908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2283edc3-61d1-4500-9132-9ecae2da2840 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.175513 Jun 18 05:19:34.908795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 205/418] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:34 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:35.035228 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:35.035849 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:35.042685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.043315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.044375 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.045000 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.188028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:35.195902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ee692a8b-fdab-4c05-85be-8853d53501cf tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.164439 Jun 18 05:19:35.196843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 214/419] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:35 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:35.323567 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:35.324185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:35.330933 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.331668 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.332675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.333327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.489235 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:35.497042 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-65486d10-fd42-4823-9ad1-f2d9ec7c53a1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.177246 Jun 18 05:19:35.501427 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 206/420] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:35 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:35.630249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:35.631877 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:35.646811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.647333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.648159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.648592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.791242 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:35.799333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ab69c363-a212-4470-8d6b-9915529955e3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.179600 Jun 18 05:19:35.800035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 215/421] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:35 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:35.929645 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:35.930278 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:35.936912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.937357 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:35.938204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:35.938638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.091179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:36.102561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:36.104098 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:36.105263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-43a02e75-3e69-45bb-8c4a-7be28c4edd2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.180557 Jun 18 05:19:36.105850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 207/422] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:35 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:36.212668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:36.213277 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:36.219619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:36.220074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.220844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:36.221282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.360949 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:36.368807 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9458bc3b-04a4-4426-802d-800c9a62f17b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.160076 Jun 18 05:19:36.369371 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 216/423] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:36 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:36.514703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:36.518721 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:36.527869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:36.528722 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.529680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:36.530274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.694932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:36.704783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3bae6ee1-704d-4c62-89ae-e110d7344609 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.193871 Jun 18 05:19:36.720102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 208/424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:36 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:36.817124 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:36.824652 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:36.825488 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:36.826146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.827097 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:36.828203 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:36.986539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:36.994348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6f84f8b8-a097-4a3e-9cd8-11e289d37496 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.182063 Jun 18 05:19:36.995034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 217/425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:36 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:37.124747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:37.125475 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:37.131836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:37.132276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:37.133033 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:37.133490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:37.281193 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:37.292018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:37.293876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:37.297812 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2e4c373d-9587-47da-8394-ed6e5b26c0df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.175850 Jun 18 05:19:37.310166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 209/426] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:37 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:37.387079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:37.387856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:37.397777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:37.398301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:37.399141 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:37.399662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:37.548170 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:37.555953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1fee3499-be81-4dc1-bf82-ac06b793a57b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.173036 Jun 18 05:19:37.556669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 218/427] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:37 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:37.722628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:37.723336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:37.729411 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:37.731604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:37.731604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:37.731604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:37.897232 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:37.905285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2e94b589-fd74-460d-bd7f-72c2c7bf240d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.187156 Jun 18 05:19:37.906129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 210/428] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:37 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:38.012529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:38.013123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:38.033088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.033596 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.034376 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.034817 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.180702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:38.189948 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2fb15fdc-cd73-4287-be1f-3391d3dae75c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.181346 Jun 18 05:19:38.190609 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 219/429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:38 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:38.317363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:38.317998 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:38.329020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.329020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.329020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.329020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.474609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:38.483614 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:38.487002 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:38.489346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-123a870b-c128-4c1d-89ad-32153e487e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.175597 Jun 18 05:19:38.490435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 211/430] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:38 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:38.572541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:38.573150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:38.580585 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.581115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.582008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.582681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.722313 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:38.729622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a25ab369-2f24-41d2-9677-f37f02551209 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.160898 Jun 18 05:19:38.730185 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 220/431] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:38 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:38.933322 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:38.939974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:38.946241 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.946691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:38.947469 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:38.947898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.100578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:39.109881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bae01d5d-8e8e-4af9-8ee5-eec46d34c879 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.180271 Jun 18 05:19:39.110475 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 212/432] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:38 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:39.206924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:39.207461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:39.214619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:39.214619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.215126 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:39.215561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.353467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:39.361852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-28db89be-540b-487d-a95a-4e998bb648a5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.158630 Jun 18 05:19:39.362273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 221/433] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:39 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:39.508267 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:39.508786 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:39.515765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:39.518043 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.518043 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:39.518043 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.647854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:39.657051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:39.658561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:39.659716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9145614a-7a2f-4a14-bf4d-c8d53f64afb8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.155501 Jun 18 05:19:39.660286 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 213/434] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:39 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:39.747108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:39.747710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:39.754169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:39.754719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.755581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:39.756026 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:39.886944 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:39.895268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0feb3020-c993-4967-b644-24ba72f8d4dc tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.151989 Jun 18 05:19:39.895847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 222/435] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:39 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:40.127648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:40.128181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:40.134228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.134676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.135440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.135877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.311178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:40.319875 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-56ae3558-c6e9-48a0-b2fb-8a81e8d725df tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.197006 Jun 18 05:19:40.320390 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 214/436] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:40 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:40.378449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:40.378958 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:40.385621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.386074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.386840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.387270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.525691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:40.534183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a5c41ff4-77a2-4463-8bc5-6b9e8adf65c0 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.159739 Jun 18 05:19:40.534742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 223/437] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:40 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:40.678744 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:40.683856 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:40.685989 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.686435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.688229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.688647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.821277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:40.834013 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:40.835643 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:40.836847 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a1f19ab2-aca7-4c4b-b031-4c17fb70b170 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.162087 Jun 18 05:19:40.837621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 215/438] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:40 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:40.912138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:40.913001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:40.919777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.920229 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:40.921005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:40.921461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:41.050851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:41.058290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7a4a65cb-4be2-4866-9425-f802e3a99c84 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.150067 Jun 18 05:19:41.058858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 224/439] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:40 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:41.337184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:41.337757 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:41.343865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:41.344310 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:41.345066 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:41.345538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:41.520049 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:41.527512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-57f5d2a3-c638-4585-afb0-7d24aa5611ab tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.194216 Jun 18 05:19:41.528079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 216/440] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:41 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:41.552152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:41.552764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:41.560153 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:41.560597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:41.561372 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:41.561850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:41.695377 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:41.702885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-304d3313-6572-4936-974d-df35102f7012 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.155201 Jun 18 05:19:41.703456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 225/441] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:41 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:41.855396 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:41.856026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:41.862678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:41.863125 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:41.863898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:41.864321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.010747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:42.019881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:42.021369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:42.022551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3b4bc084-0c83-4077-83c0-973482fff392 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.171093 Jun 18 05:19:42.023117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 217/442] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:41 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:42.075423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:42.076035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:42.082716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:42.083163 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.083917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:42.084356 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.280215 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:42.289734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-35f53398-f72e-465b-95fe-6b965d6344a3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.218001 Jun 18 05:19:42.294382 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 226/443] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:42 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:42.544394 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:42.545010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:42.551814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:42.552263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.553024 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:42.553502 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.685475 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:42.694690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f89f9f4c-be44-4f18-93b3-7219481a01d3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.154148 Jun 18 05:19:42.695261 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 218/444] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:42 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:42.719874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:42.720488 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:42.727286 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:42.727941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.728721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:42.729157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:42.860439 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:42.868056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cc5f46cb-2675-4baf-9cdc-f1457f6a8a54 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.152300 Jun 18 05:19:42.868615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 227/445] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:42 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:43.041997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:43.042724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:43.050409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.050929 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.051766 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.052434 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.183868 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:43.194045 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:43.195756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:43.203152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-36489402-ac2f-408f-9be4-3be57002edc2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.159016 Jun 18 05:19:43.203152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 219/446] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:43 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:43.306919 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:43.307529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:43.313660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.314107 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.314859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.315291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.335256 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:43.449211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:43.457204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f801fff7-7fe0-48b7-aa09-899d4ceb9ed0 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.154190 Jun 18 05:19:43.457802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 228/447] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:43 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:43.711871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:43.712482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:43.718458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.718910 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.719880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.720496 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.724492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:43.856827 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:43.865476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5dbc1484-4b7c-4b05-9bb7-b52f3542556e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.157425 Jun 18 05:19:43.866138 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 220/448] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:43 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:43.885233 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:43.886211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:43.893374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.894008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.894898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:43.895409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:43.987228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-b25c5dd0-5ee1-4b31-bd13-a10cd7f209ee req-b5d2bfd5-3689-4725-b278-ab90918271b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a0202f-1150-49ed-a508-fbba8692b1d7", "name": "network-vif-plugged", "status": "completed", "tag": "451c6eb3-9c80-4e4a-8271-8a7ff22fcc68"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:44.004114 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-b25c5dd0-5ee1-4b31-bd13-a10cd7f209ee req-b5d2bfd5-3689-4725-b278-ab90918271b8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.013764 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-b25c5dd0-5ee1-4b31-bd13-a10cd7f209ee req-b5d2bfd5-3689-4725-b278-ab90918271b8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:44.040982 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-b25c5dd0-5ee1-4b31-bd13-a10cd7f209ee req-b5d2bfd5-3689-4725-b278-ab90918271b8 service nova] Creating event network-vif-plugged:451c6eb3-9c80-4e4a-8271-8a7ff22fcc68 for instance 17a0202f-1150-49ed-a508-fbba8692b1d7 on hv-cinder-83699 Jun 18 05:19:44.051377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-b25c5dd0-5ee1-4b31-bd13-a10cd7f209ee req-b5d2bfd5-3689-4725-b278-ab90918271b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069063 Jun 18 05:19:44.056540 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 221/449] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:44.061636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:44.069895 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b3290089-8aeb-458a-b32d-d434e05ffe14 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.188258 Jun 18 05:19:44.070561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 229/450] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:43 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:44.216850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:44.217569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:44.225751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.226076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:44.226889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.227344 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:44.474230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:44.475356 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:44.482765 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.483580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:44.484635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.485471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:44.560945 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:44.570876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:44.572677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:44.574078 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1dca2d8c-9399-47a6-8203-9ec889969c3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.361877 Jun 18 05:19:44.574972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 222/451] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:44 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:44.835215 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:44.843478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-00fb85cd-d144-4147-a27e-c59a6c03873c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.373169 Jun 18 05:19:44.844060 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 230/452] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:44 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:44.886494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:44.887108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:44.889080 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:44.893989 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.894438 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:44.895205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:44.895641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:45.048030 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:45.064613 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-585d2359-9b52-4c9b-87d0-792cff0e692f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.179539 Jun 18 05:19:45.065546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 223/453] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:44 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:45.089497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:45.091136 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:45.102744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:45.103204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:45.103992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:45.104430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:45.248705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:45.256301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-afa39171-5bc2-470a-bff6-51c0ad4d2d57 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.173164 Jun 18 05:19:45.257508 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 231/454] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:45 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:45.594561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:45.595869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:45.604129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:45.604585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:45.605368 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:45.605856 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:45.740976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:45.747204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:45.748723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:45.750003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fcf1592d-46e7-404b-974b-32043b2016c5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.159285 Jun 18 05:19:45.750562 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 224/455] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:45 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:45.860012 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:45.860658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:45.867613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:45.867848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:45.868488 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:45.868936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.009252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:46.016889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6f7d9942-4571-48af-8d30-ddcd6adb5a54 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.160690 Jun 18 05:19:46.018827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 232/456] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:45 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:46.068257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-64acb2ca-71e9-4bd2-ac4c-2670fb1f4a78 req-84e79750-9ffe-4b10-babf-27304e36709c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "name": "network-vif-plugged", "status": "completed", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:46.076251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-64acb2ca-71e9-4bd2-ac4c-2670fb1f4a78 req-84e79750-9ffe-4b10-babf-27304e36709c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.076694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-64acb2ca-71e9-4bd2-ac4c-2670fb1f4a78 req-84e79750-9ffe-4b10-babf-27304e36709c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.087334 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:46.088015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:46.088713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-64acb2ca-71e9-4bd2-ac4c-2670fb1f4a78 req-84e79750-9ffe-4b10-babf-27304e36709c service nova] Creating event network-vif-plugged:2e6ea935-169b-426c-bf26-11d644b1d476 for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b on hv-cinder-83699 Jun 18 05:19:46.098532 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.099173 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-64acb2ca-71e9-4bd2-ac4c-2670fb1f4a78 req-84e79750-9ffe-4b10-babf-27304e36709c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035601 Jun 18 05:19:46.099794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.100282 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 225/457] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:46.100660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.101108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.274810 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:46.275698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:46.282506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.283727 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.284661 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.285106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.311312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:46.320137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b7a4d038-4744-426f-9e77-0cee9d66c55c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.236338 Jun 18 05:19:46.320728 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 233/458] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:46 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:46.429164 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:46.436776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9f3afdb9-06ec-4bc8-b7ba-e50d89af6e62 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.166264 Jun 18 05:19:46.437319 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 226/459] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:46 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:46.768798 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:46.769490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:46.771366 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:46.776055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.776507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.777284 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:46.777748 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:46.916547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:46.926250 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:46.928840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:46.930735 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-40af1450-c635-4c68-98f9-bf30c4ef18f3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.166552 Jun 18 05:19:46.931461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 234/460] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:46 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:47.039187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:47.039858 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:47.047228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.047967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.049659 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.050294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.193750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:47.201907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f141854d-cafd-4e70-a243-72359ce809a5 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1314 microversion: 2.1 time: 0.166618 Jun 18 05:19:47.206437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 227/461] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:47 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:47.337972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:47.338624 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:47.346121 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.346589 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.347368 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.347804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.454879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:47.455481 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:47.461659 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.462096 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.462850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.463277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.488636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:47.496438 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e81d698d-0608-4fee-8bce-8669f07f67ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.162455 Jun 18 05:19:47.497159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 235/462] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:47 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:47.816443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:47.824008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-45d44100-0439-4e92-9e8f-56e94d5ea161 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1500 microversion: 2.1 time: 0.373157 Jun 18 05:19:47.824634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 228/463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:47 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1500 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:47.841671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fb813f4-a3bc-4a69-b622-f55529df58ee"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:47.842789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:47.849437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.849888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.850644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.851076 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.883519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] HTTP exception thrown: Cannot 'attach_volume' instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 while it is in vm_state rescued Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Request method failure captured: Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/os-volume_attachments HTTP/1.1 Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 74 Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWAJTmp380dwdux2DLXsjuCyStbEwHWeVdk1L8sPhOY-wMgt-oCcWucBg5mR83XOLVrNVoiU2W3UcaCweUZEXENzGwjYzcjFATyv5s4j9ODrKTRUVkasIbCgO3KpsyDUdpVUraDNk4_KY4ro-hkG4XupJZ8dnfrS-1kqTxoStVmDU0g Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:19:47.885224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8820096253064e5abbe50f23bdc3ebac"}]}] Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 216d2b492c55410d9563051142048160 Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {"volumeAttachment": {"volumeId": "8fb813f4-a3bc-4a69-b622-f55529df58ee"}} Jun 18 05:19:47.886768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Cannot 'attach_volume' instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 while it is in vm_state rescued Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'server_id': '73b2fdbe-e24f-4092-bf52-db5c0a24f250', 'body': {'volumeAttachment': {'volumeId': '8fb813f4-a3bc-4a69-b622-f55529df58ee'}}} Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:19:47.887688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 while it is in vm_state rescued Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:19:47.889070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 while it is in vm_state rescued Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Returning 409 to user: Cannot 'attach_volume' instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 while it is in vm_state rescued {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5bc354c3-202e-4ba3-82a0-0a3f18d3a560 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049127 Jun 18 05:19:47.890447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 236/464] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:19:47 2022] POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 18 05:19:47.896316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:47.896863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:47.903337 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.904092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.904823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.905261 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.949487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:47.950164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:47.957339 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.957820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:47.958586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:47.959021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.105310 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:48.115068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:48.116634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c6e8afdc-2032-4734-b209-9695b759a8c8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/action" status: 202 len: 0 microversion: 2.1 time: 0.224006 Jun 18 05:19:48.116634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 229/465] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:19:47 2022] POST /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:19:48.116837 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:48.118271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e05a561f-83c0-4a6b-b0e2-805927767821 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.172734 Jun 18 05:19:48.118818 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 237/466] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:47 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:48.124912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:48.125704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:48.132458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:48.132931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.133724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:48.134158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.222117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:48.222801 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:48.228920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:48.229374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.230259 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:48.230954 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.274511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:48.297516 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-275720d6-905c-404d-9fa9-a8e7a6cd10e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.167984 Jun 18 05:19:48.298477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 230/467] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:48 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:48.386346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:48.395016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bf634322-8b97-494e-8e6a-2aeb54740fd3 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1498 microversion: 2.1 time: 0.177347 Jun 18 05:19:48.395642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 238/468] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:48 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:48.513172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:48.513816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:48.520381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:48.520864 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.521705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:48.522142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:48.659243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:48.666916 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-51838b6b-0954-44c9-8ea2-97b63402aa77 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.157586 Jun 18 05:19:48.667520 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 231/469] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:48 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:49.137171 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:49.137702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:49.144503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.146260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.146260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.146260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.308509 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:49.316124 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:49.316829 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:49.318852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:49.320395 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:49.321600 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-521a1dff-c072-4547-8124-3108ec367087 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.188335 Jun 18 05:19:49.322713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 239/470] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:49 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:49.323676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.324131 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.325279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.325746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.413941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:49.414437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:49.420829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.421278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.422070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.422507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.448246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:19:49.458764 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:49.466639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-64d3fb22-041f-4373-ba46-084ff43c8b08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.155304 Jun 18 05:19:49.467205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 232/471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:49 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:49.684151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:49.684759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:49.690787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.691224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.691965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.692509 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.741242 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-92e9562b-204d-48b7-8550-01fd392eb6b8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 204 len: 0 microversion: 2.1 time: 0.330725 Jun 18 05:19:49.741873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 240/472] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:19:49 2022] DELETE /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 05:19:49.750391 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:49.751131 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:49.757233 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.757704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.758465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:49.758894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:49.824449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:49.833261 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-81cc5f7e-e417-4f87-8510-ee4fb4616179 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.153012 Jun 18 05:19:49.833989 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 233/473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:49 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:49.887434 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:49.895426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fa9a2aa1-9048-4969-ad35-495e53e2e395 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.149197 Jun 18 05:19:49.895995 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 241/474] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:49 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:50.341043 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:50.341673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:50.347630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.348076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.348831 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.349263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.480243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:50.483719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:50.484319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:50.489428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:50.490927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:50.491355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.491791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.492088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3356538f-a10e-49d8-ac18-5280184c1508 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.155005 Jun 18 05:19:50.492541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.492638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 234/475] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:50 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:50.492981 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.654985 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:50.663354 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e1702556-f49c-48a4-9879-aa6e179663cf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.183314 Jun 18 05:19:50.663942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 242/476] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:50 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:50.850857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:50.851462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:50.858095 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.858540 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.859293 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.859728 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.913682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:50.914330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:50.920359 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.920880 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.921776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:50.922299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:50.994861 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:51.002330 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-22b24445-3702-4270-bdff-e3c7a6549442 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.155329 Jun 18 05:19:51.003057 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 235/477] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:50 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:51.056796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:51.060431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:51.065333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-af146dc4-e751-438c-8af0-f31d930ccde1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.155460 Jun 18 05:19:51.065842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 243/478] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:50 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:51.510557 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:51.512012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:51.518521 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:51.518968 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:51.519731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:51.520167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:51.666208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:51.675265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:51.680661 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:51.681302 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:51.688380 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:51.688829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:51.691099 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:51.692320 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4fcebd76-f99c-4831-80f0-7140a41cde44 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.185712 Jun 18 05:19:51.692916 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 236/479] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:51 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:51.693219 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:51.693705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:51.830520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:51.838737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0021016f-1c96-4c16-bafa-420950db011c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.161909 Jun 18 05:19:51.839320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 244/480] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:51 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:52.020426 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:52.021326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:52.027583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.028028 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.028791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.029497 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.034353 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:52.082871 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:52.083484 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:52.089515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.089967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.090727 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.091287 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.162187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:52.170052 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-06f3328b-269d-44c3-86ed-c1d437eb2e3d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.154766 Jun 18 05:19:52.170631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 237/481] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:52 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:52.233344 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:52.241843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-480b0af3-4fdb-4386-9817-0a3fc40aad80 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.163402 Jun 18 05:19:52.242410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 245/482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:52 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:52.710402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:52.711006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:52.716972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.717458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.718216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.718650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.851207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:52.856725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:52.857333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:52.859742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:52.861844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:52.863016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-09067571-fb4c-468e-b017-78c29f3c8f63 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.156553 Jun 18 05:19:52.863574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 238/483] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:52 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:52.864483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.864933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.865724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:52.866160 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:52.994233 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:53.001779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5426f85c-0e85-4e44-958c-880210397e31 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.148644 Jun 18 05:19:53.002512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 246/484] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:52 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:53.187088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:53.187686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:53.194576 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.195011 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.196018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.196449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.259165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:53.259799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:53.265676 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.266119 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.266874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.267303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.328814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:53.337202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a4678ca7-1d84-476f-9368-4521072fb630 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.153976 Jun 18 05:19:53.338243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 239/485] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:53 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:53.399642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:53.407564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7187fe3e-1a8d-47d2-869c-d0b8cf5d951b tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.152509 Jun 18 05:19:53.408296 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 247/486] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:53 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:53.884636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:53.885264 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-aa8bd612-4fad-4ba4-93a6-5e5e92b282b2 req-1508efb0-3694-4b10-b41d-037d64ea76c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "name": "network-vif-plugged", "status": "completed", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:53.887887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:53.895630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.896086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.896863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.897299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.898818 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-aa8bd612-4fad-4ba4-93a6-5e5e92b282b2 req-1508efb0-3694-4b10-b41d-037d64ea76c3 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:53.899239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-aa8bd612-4fad-4ba4-93a6-5e5e92b282b2 req-1508efb0-3694-4b10-b41d-037d64ea76c3 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:53.912978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-aa8bd612-4fad-4ba4-93a6-5e5e92b282b2 req-1508efb0-3694-4b10-b41d-037d64ea76c3 service nova] Creating event network-vif-plugged:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:19:53.918805 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-aa8bd612-4fad-4ba4-93a6-5e5e92b282b2 req-1508efb0-3694-4b10-b41d-037d64ea76c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045099 Jun 18 05:19:53.920111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 240/487] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:54.026548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:54.027320 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:54.035146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:54.035615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:54.036522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:54.036953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:54.038858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:54.047332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:54.049117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:54.050316 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-56e9da9c-9281-4845-bdd5-75bba564b48a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.172058 Jun 18 05:19:54.050875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 248/488] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:53 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:54.172740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:54.181907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fc8bc1b2-a6f2-4397-a85c-a0dae7f64aab tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.158156 Jun 18 05:19:54.182517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 241/489] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:54 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:54.354742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:54.355348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:54.361437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:54.362269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:54.363033 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:54.363460 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:54.424500 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:54.428674 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:54.433949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:54.434412 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:54.435266 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:54.435723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:54.528245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:54.537512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ed67bc97-88dc-4468-9e24-69a6ef84d3aa tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1260 microversion: 2.1 time: 0.186443 Jun 18 05:19:54.549708 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 249/490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:54 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:54.588876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:54.596983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2081be23-6f06-4b07-9173-bd02fa6435e1 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.176759 Jun 18 05:19:54.597592 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 242/491] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:54 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:55.068977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:55.069628 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.076438 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.076977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.077779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.078220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.199616 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:55.200798 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.207691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.208380 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.209157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.209651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.261448 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.271071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.272585 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.273789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1bf48820-fe12-408d-933e-2c5e8993d650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.208994 Jun 18 05:19:55.274355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 250/492] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:55 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:55.351402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.358941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-941089f0-e223-4d30-874c-003dda7ea748 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.163487 Jun 18 05:19:55.359513 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 243/493] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:55 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:55.371778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:55.372786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.379724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.380165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.380959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.381334 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.554142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:55.554783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.561398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.561853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.562613 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.563041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.580394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3c0efb17-a643-4fa4-9e17-ed461ea07f96 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/action" status: 202 len: 0 microversion: 2.1 time: 0.211790 Jun 18 05:19:55.585157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 251/494] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:19:55 2022] POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:19:55.589935 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:55.590738 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.597179 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.597657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.598427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.598865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.727208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.739927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-46a9779b-88ec-43c0-9fe1-09aedc25aac6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1443 microversion: 2.1 time: 0.189456 Jun 18 05:19:55.741117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 244/495] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:55 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1443 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:55.754552 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:55.755169 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.763284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.763284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.766925 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.766925 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.872658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.882615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f19980f4-8cda-47ee-a912-4b47d8f7aa21 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1749 microversion: 2.1 time: 0.296720 Jun 18 05:19:55.883449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 252/496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:55 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1749 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:55.888181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:55.888775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:55.896518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.896966 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.897759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:55.898684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:55.909935 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:55.918482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6c5ed606-d5f0-45a5-b251-91766be26550 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.176241 Jun 18 05:19:55.919638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 245/497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:55 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:56.041230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:56.048744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c2cc48fa-b6e1-44cf-bf95-9cf5fc22be2f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1443 microversion: 2.1 time: 0.164137 Jun 18 05:19:56.049375 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 253/498] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:55 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:56.293211 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:56.294814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:56.300843 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.301295 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.302100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.302638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.375804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:56.376545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:56.387699 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.389780 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.390660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.391177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.603541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:56.615763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:56.617515 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:56.619265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3a5d56a9-e5b7-41ec-9dad-4c458bb1f54e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.329724 Jun 18 05:19:56.626457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 246/499] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:56 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:56.823482 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:56.831500 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1ff10afc-7a9c-4acb-a39c-66689180831e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.459623 Jun 18 05:19:56.832071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 254/500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:56 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:56.906766 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:56.907891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:56.918841 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.919628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.920614 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.921215 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.935692 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:56.936303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:56.958581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.958940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:56.959900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:56.960508 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:57.128624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:57.137141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ca6437e0-76fa-4c4f-aa55-60e1b8522354 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1749 microversion: 2.1 time: 0.238474 Jun 18 05:19:57.137768 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 247/501] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:56 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1749 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:57.197295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:57.205241 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-68749713-cc1d-4ad2-afb3-a43045a1b709 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1504 microversion: 2.1 time: 0.273309 Jun 18 05:19:57.206046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 255/502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:56 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:57.325015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-605c0837-b216-41ff-9487-e1840f66330a req-196e2ca6-c19c-4c5f-b05c-5d882c27fb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a0202f-1150-49ed-a508-fbba8692b1d7", "name": "network-vif-deleted", "tag": "451c6eb3-9c80-4e4a-8271-8a7ff22fcc68"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:57.334332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-605c0837-b216-41ff-9487-e1840f66330a req-196e2ca6-c19c-4c5f-b05c-5d882c27fb4e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:57.334889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-605c0837-b216-41ff-9487-e1840f66330a req-196e2ca6-c19c-4c5f-b05c-5d882c27fb4e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:57.347934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-605c0837-b216-41ff-9487-e1840f66330a req-196e2ca6-c19c-4c5f-b05c-5d882c27fb4e service nova] Creating event network-vif-deleted:451c6eb3-9c80-4e4a-8271-8a7ff22fcc68 for instance 17a0202f-1150-49ed-a508-fbba8692b1d7 on hv-cinder-83699 Jun 18 05:19:57.353054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-605c0837-b216-41ff-9487-e1840f66330a req-196e2ca6-c19c-4c5f-b05c-5d882c27fb4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Jun 18 05:19:57.353696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 248/503] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:19:57.638196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:57.639142 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:57.647842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:57.648286 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:57.649091 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:57.649636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:57.849908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:57.850535 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:57.856644 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:57.857088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:57.857867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:57.858297 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:58.002454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:58.003272 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:58.007635 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-392283c9-39c5-45e5-b3f4-33cd40e6af71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.163256 Jun 18 05:19:58.008288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 249/504] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:57 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:19:58.011054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:58.012575 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:58.013754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fac7a176-b92c-4ae2-8d3f-044f3a0ed63f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.379741 Jun 18 05:19:58.014468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 256/505] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:57 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:19:58.154550 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:58.155111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:58.161513 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:58.161945 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:58.162705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:58.163134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:58.227220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:58.228001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:58.240805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:58.243507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:58.244516 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:58.244960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:58.325962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:58.331437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:58.336477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b0e2cba9-9852-4150-a2c0-28a7472ba6c7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1749 microversion: 2.1 time: 0.186028 Jun 18 05:19:58.337406 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 250/506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:58 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:58.348826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-79332ceb-625c-45cc-baaa-46972e321382 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1299 microversion: 2.1 time: 0.129563 Jun 18 05:19:58.349450 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 257/507] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:58 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:59.024773 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:59.025537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:59.034860 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:59.035412 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.036177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:59.038325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.040264 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.041339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.042665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.043273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.044343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.045088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.205779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:59.217739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:59.219664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:59.221050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-65fd7e0d-ec6c-4a8a-9de9-7f03cfa452a8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.191682 Jun 18 05:19:59.222181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 258/508] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:19:59 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:19:59.248011 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:59.258104 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d13a63f2-b15d-4211-accf-4f5a27785470 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1508 microversion: 2.1 time: 0.237285 Jun 18 05:19:59.258688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 251/509] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:59 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:59.354293 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:59.354909 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:59.364009 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.364419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.366441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.366561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:19:59.367165 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:19:59.368571 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.383233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.383677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.384441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.384874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.397213 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:19:59.522566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:59.535024 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8945dcc7-8c99-4fdf-9c83-8741e3d3c12c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1299 microversion: 2.1 time: 0.173551 Jun 18 05:19:59.546412 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 252/510] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:59 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:19:59.552119 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-caac63f9-de9e-493c-b371-732382a873fc req-2c4f3721-039e-4917-b64d-7245b5121d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:19:59.560729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-caac63f9-de9e-493c-b371-732382a873fc req-2c4f3721-039e-4917-b64d-7245b5121d3a service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:19:59.561537 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-caac63f9-de9e-493c-b371-732382a873fc req-2c4f3721-039e-4917-b64d-7245b5121d3a service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:19:59.574649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-caac63f9-de9e-493c-b371-732382a873fc req-2c4f3721-039e-4917-b64d-7245b5121d3a service nova] Creating event network-changed:2e6ea935-169b-426c-bf26-11d644b1d476 for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b on hv-cinder-83699 Jun 18 05:19:59.580339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-caac63f9-de9e-493c-b371-732382a873fc req-2c4f3721-039e-4917-b64d-7245b5121d3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032358 Jun 18 05:19:59.581199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 253/511] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:19:59.591852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:19:59.612734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3c34151c-a38d-4c1b-a83a-82a6ece04acc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1749 microversion: 2.1 time: 0.261376 Jun 18 05:19:59.628239 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 259/512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:19:59 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1749 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:00.244521 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:00.245336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:00.256720 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.257688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.259633 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.260636 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.278339 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:00.279929 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:00.290148 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.290798 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.291636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.292750 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.443600 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:00.452000 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-33f21fc2-a898-4edb-8a1d-15f0a6a81151 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1514 microversion: 2.1 time: 0.180554 Jun 18 05:20:00.464708 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 260/513] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:00 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:00.465503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:00.478997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:00.480716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:00.482083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8974b323-b04d-45fe-8ef0-57d788d29207 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1808 microversion: 2.20 time: 0.245698 Jun 18 05:20:00.482714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 254/514] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:20:00 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:20:00.555551 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:00.556252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:00.569174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.572303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.573237 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.573696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.620621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.621062 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.621528 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lazy-loading 'fault' on Instance uuid 17a0202f-1150-49ed-a508-fbba8692b1d7 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:20:00.631372 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:00.631911 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:00.638164 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.638617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.639381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:00.639820 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:00.663002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:00.671330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bed1a7ea-fa90-44d0-a7f9-388221e5fc8c tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1304 microversion: 2.1 time: 0.120640 Jun 18 05:20:00.671930 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 261/515] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:00 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:00.884072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:00.887980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:00.893090 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-92452f0c-fbf0-4bbd-9b66-618f84b2a659 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1749 microversion: 2.1 time: 0.266286 Jun 18 05:20:00.893691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 255/516] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:00 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1749 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:01.507735 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:01.508974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:01.515685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.516224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:01.517059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.518569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:01.681623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:01.687830 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:01.688425 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:01.692487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:01.694515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:01.696113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-25e76683-b1f3-4d5d-b37f-3435edcea985 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1795 microversion: 2.20 time: 0.192488 Jun 18 05:20:01.697105 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.697602 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:01.698347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.698881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:01.709808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 262/517] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:20:01 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1795 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:20:01.732556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.732996 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:01.733517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lazy-loading 'fault' on Instance uuid 17a0202f-1150-49ed-a508-fbba8692b1d7 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:20:01.799133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4147695d07c24202b096fb7da07ecf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63728833c434410864d0d7431a9fac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:01.807439 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b376ac1b-f882-4253-ab5b-6b4a80540354 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 200 len: 1304 microversion: 2.1 time: 0.123041 Jun 18 05:20:01.808063 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 256/518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:01 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:01.912331 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:01.919301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:01.928147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.930119 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:01.930899 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:01.931329 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:02.153054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:02.162960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ecfa4e7a-4583-4bcb-85ab-bee56e2d2400 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.256707 Jun 18 05:20:02.163533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 263/519] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:01 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:02.256236 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dd9edc87-4982-4225-a1bd-4c6802a46c08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'create', calling method: .version_select at 0x7f7b01e22310>, body: {"keypair": {"name": "tempest-keypair-855682562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGSOwAapDoOVYnKBvkUiEsO/7j/XtkbfpVjT4BED+B5GRCW0KCszvEDyeEiVymkDsLXkfs/g/xT0x3z8qLjAWKp5vbSlrFptbSs2eCIkqDSj8RRe5TXf+xvoPWtT8nqSg=="}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:02.276457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-dd9edc87-4982-4225-a1bd-4c6802a46c08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for project 8820096253064e5abbe50f23bdc3ebac. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:20:02.280624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-dd9edc87-4982-4225-a1bd-4c6802a46c08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for user 216d2b492c55410d9563051142048160 and project 8820096253064e5abbe50f23bdc3ebac. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:20:02.405794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dd9edc87-4982-4225-a1bd-4c6802a46c08 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153340 Jun 18 05:20:02.406418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 257/520] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:20:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:02.825631 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:02.826255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] [instance: 17a0202f-1150-49ed-a508-fbba8692b1d7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:02.833287 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:02.833770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:02.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:02.834978 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:02.850702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] HTTP exception thrown: Instance 17a0202f-1150-49ed-a508-fbba8692b1d7 could not be found. Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Request method failure captured: Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 HTTP/1.1 Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWAojug3A6dfwDDT3q29-45M_ZDsYshylrl12iD4KNMFzmOp2lu1RbbJSolH80FA1sk_c6slnjZHaeSW6uCnilwvwx6yYcC_1vmsRtTtA4hskw86H2JQr-HKTuZWdjh4CI1ciqaByeqZhAAOVoe4cH8MA4QpoQcw3iJHt-sIVBGs3dE Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: a63728833c434410864d0d7431a9fac2 Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesActionsTest-198952152 Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:20:02.852397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a63728833c434410864d0d7431a9fac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a63728833c434410864d0d7431a9fac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a63728833c434410864d0d7431a9fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a63728833c434410864d0d7431a9fac2"}]}] Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesActionsTest-198952152 Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: a63728833c434410864d0d7431a9fac2 Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesActionsTest-198952152 Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesActionsTest-198952152-project Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 4147695d07c24202b096fb7da07ecf37 Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesActionsTest-198952152-project Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 17a0202f-1150-49ed-a508-fbba8692b1d7 could not be found. Jun 18 05:20:02.859858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '17a0202f-1150-49ed-a508-fbba8692b1d7'} Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a0202f-1150-49ed-a508-fbba8692b1d7 could not be found. Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:20:02.860799 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a0202f-1150-49ed-a508-fbba8692b1d7 could not be found. Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a0202f-1150-49ed-a508-fbba8692b1d7 could not be found. Jun 18 05:20:02.862458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:20:02.863697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] Returning 404 to user: Instance 17a0202f-1150-49ed-a508-fbba8692b1d7 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:20:02.863697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0d432b2b-e105-40e1-a69a-9aa08e238ea8 tempest-VolumesActionsTest-198952152 tempest-VolumesActionsTest-198952152-project] 10.222.0.23 "GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7" status: 404 len: 111 microversion: 2.1 time: 0.032234 Jun 18 05:20:02.863697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 264/521] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:02 2022] GET /compute/v2.1/servers/17a0202f-1150-49ed-a508-fbba8692b1d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:20:03.185761 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:03.186977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:03.194649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:03.200294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:03.200294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:03.200294 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:03.551831 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:03.566553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d61509ee-7e90-4660-beb7-380bfe773675 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.383218 Jun 18 05:20:03.566553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 258/522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:03 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:04.578102 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:04.579462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:04.590607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:04.591796 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:04.592920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:04.593627 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:04.779123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:04.793041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-263e4272-b8df-46d0-a3b6-a90124dc5360 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.218802 Jun 18 05:20:04.806868 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 265/523] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:04 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:05.384356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2095547907", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e40c5bf8-60a8-4d08-b489-6f107ba55c42"}], "security_groups": [{"name": "tempest-securitygroup--1390950543"}], "key_name": "tempest-keypair-855682562", "user_data": "}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:05.499612 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] validate_networks() for [('e40c5bf8-60a8-4d08-b489-6f107ba55c42', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:20:05.813519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:05.814095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:05.822472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:05.823157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:05.824116 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:05.824705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:05.909365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:20:05.909915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:20:05.910308 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:20:05.910673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:20:05.911088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:20:05.921012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:05.921513 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:05.926784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:05.926784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:05.941676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for project 8820096253064e5abbe50f23bdc3ebac. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:20:05.946194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Getting quotas for user 216d2b492c55410d9563051142048160 and project 8820096253064e5abbe50f23bdc3ebac. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:20:05.959288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:20:05.961949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:20:05.982022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:06.070020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:06.080307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6d12c54c-bf21-4a52-b2eb-03547daa62ad tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.272401 Jun 18 05:20:06.090605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 266/524] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:05 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:06.094466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4d95dfe5-7894-43b7-a752-63b9e2855d84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.714931 Jun 18 05:20:06.095363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 259/525] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:20:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:20:06.107483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c863edea-baf8-4fa7-85c1-15b5c5020022 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:06.109225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c863edea-baf8-4fa7-85c1-15b5c5020022 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:06.199747 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c863edea-baf8-4fa7-85c1-15b5c5020022 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:06.208890 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c863edea-baf8-4fa7-85c1-15b5c5020022 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1245 microversion: 2.1 time: 0.106513 Jun 18 05:20:06.209915 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 267/526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:06 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:07.100011 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:07.100778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:07.108926 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:07.109501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:07.110896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:07.111489 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:07.228199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:07.229972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:07.240108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:07.242212 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:07.243850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:07.244309 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:07.331417 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:07.350317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:07.356756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4cd2f077-509b-4ac5-8e41-c0e16d7301ac tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.261981 Jun 18 05:20:07.362567 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 260/527] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:07 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:07.365950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3f1c0943-a148-4c55-9ad2-0f0a68455ac3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1249 microversion: 2.1 time: 0.141019 Jun 18 05:20:07.376041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 268/528] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:07 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1249 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:08.381768 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:08.382473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:08.383691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:08.384797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:08.391219 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:08.391869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:08.392170 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:08.392635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:08.392803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:08.393244 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:08.393426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:08.394638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:08.485129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:08.501123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-242eeddd-aad4-47c1-9470-f056a5d19ef1 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1297 microversion: 2.1 time: 0.121002 Jun 18 05:20:08.502097 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 269/529] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:08 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:08.571495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:08.580033 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-537bdf36-a079-4015-9243-51a5d9d652e9 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.205260 Jun 18 05:20:08.580694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 261/530] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:08 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:09.517858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:09.518975 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:09.535023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:09.535745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:09.536806 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:09.537490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:09.600580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:09.601788 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:09.616692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:09.619703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:09.622126 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:09.622800 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:09.651649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:09.667398 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b5ac5a78-b730-4099-ae8b-4f91d4b6d02b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1303 microversion: 2.1 time: 0.153188 Jun 18 05:20:09.669201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 270/531] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:09 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:10.081783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:10.094225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-46bbf532-4625-4d33-b270-3972f8c47022 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.499103 Jun 18 05:20:10.095314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 262/532] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:09 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:10.705278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:10.705278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:10.705278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:10.705278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:10.706068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:10.707166 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:11.114429 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:11.115834 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:11.135725 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:11.138553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:11.139463 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:11.139935 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:11.374439 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:11.390284 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-77dba363-fa05-4255-96f7-b76157508bd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.705809 Jun 18 05:20:11.395159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 271/533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:10 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:11.870066 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:11.884257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8950c196-b321-4268-a91c-7a1ac30a3182 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.775979 Jun 18 05:20:11.891586 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 263/534] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:11 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:12.267506 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-601de730-2162-4076-a5b1-a4e18293e8b3 req-896b3acf-27aa-4f65-9cd4-66e509333fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdfd285-b389-41f4-9ec6-596c6b160f61", "tag": "1076f134-7839-4b58-b50b-1f994d3b47a5"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:12.293911 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-601de730-2162-4076-a5b1-a4e18293e8b3 req-896b3acf-27aa-4f65-9cd4-66e509333fc4 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:12.296833 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-601de730-2162-4076-a5b1-a4e18293e8b3 req-896b3acf-27aa-4f65-9cd4-66e509333fc4 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:12.339817 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-601de730-2162-4076-a5b1-a4e18293e8b3 req-896b3acf-27aa-4f65-9cd4-66e509333fc4 service nova] Creating event network-changed:1076f134-7839-4b58-b50b-1f994d3b47a5 for instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 on hv-cinder-83699 Jun 18 05:20:12.348423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-601de730-2162-4076-a5b1-a4e18293e8b3 req-896b3acf-27aa-4f65-9cd4-66e509333fc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085396 Jun 18 05:20:12.353538 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 272/535] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:12.411982 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:12.412754 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:12.423119 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:12.426373 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:12.431079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:12.431835 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:12.872736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:12.885963 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-be6165f6-af81-4152-863e-d21bb6abe9a3 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.475811 Jun 18 05:20:12.886823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 264/536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:12 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:12.907490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:12.908201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:12.920038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:12.920475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:12.921265 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:12.921728 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:13.433003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:13.460728 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-aceac41d-edb1-4b27-9a9a-83fca3da85f7 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.557748 Jun 18 05:20:13.461564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 273/537] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:12 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:13.905367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:13.905797 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:13.932615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:13.936237 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:13.937400 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:13.938012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:14.249556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:14.265174 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-aa1aa584-0d4e-408e-a94f-6fb094fad7cb tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.365215 Jun 18 05:20:14.278176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 265/538] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:13 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:14.478517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:14.479108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:14.487777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:14.488231 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:14.489009 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:14.489470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:14.716692 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:14.732311 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1eaffdab-8700-40b0-ad1f-632530533309 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.256740 Jun 18 05:20:14.736578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 274/539] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:14 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:15.286554 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:15.288007 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:15.295493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:15.296367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:15.297369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:15.298151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:15.517932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:15.527216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dead7692-b330-486a-92b8-22f8ec04f692 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.245337 Jun 18 05:20:15.527719 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 266/540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:15 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:15.751655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:15.752872 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:15.764551 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:15.766071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:15.767034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:15.767617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:15.963046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:15.972754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0f3eaad4-15fb-4fa2-a749-a6a7636174a2 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.225854 Jun 18 05:20:15.973955 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 275/541] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:15 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:16.544319 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:16.544931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:16.551862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:16.554932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=10 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:16.555564 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:16.556267 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:16.557315 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:16.558219 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:16.799703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:16.809931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2b6a9bca-eb10-4093-95ee-72f34c0f3a9c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.269397 Jun 18 05:20:16.810688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 267/542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:16 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:16.990983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:16.991600 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:16.993631 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:16.997083 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:17.007043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:17.007906 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:17.008856 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:17.009466 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:17.332714 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:17.346152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-42d5a652-b4fd-479c-a7c7-0510ed24674c tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1754 microversion: 2.1 time: 0.359845 Jun 18 05:20:17.348208 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 276/543] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:16 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1754 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:17.829898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:17.831736 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:17.841085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:17.844457 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:17.847253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:17.848078 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:18.000960 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b19f6fa6-bd7c-4a04-bb76-06db31177d61 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Action: 'create', calling method: .version_select at 0x7f7b0153d0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-330640060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/guoGnjYflkqmRfMtRC9F1+twe3siK0pf9xUR9WbnVMa3SRRWPX4GA3A9RKwJFNMhhZFLGgkQcI005Jb6vPWEp0JkBuZSeN9/8r3MjkeT4y3mDrMnlWIOVsa+J9iDUgw=="}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:18.023045 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b19f6fa6-bd7c-4a04-bb76-06db31177d61 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:20:18.028555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b19f6fa6-bd7c-4a04-bb76-06db31177d61 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for user 6d24c8fbdc7246e2af87004f2985a9f5 and project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:20:18.065802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:18.074876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-646a67b6-0e2f-4da9-a5b1-5fdd0d34253c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.249984 Jun 18 05:20:18.077123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 277/544] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:17 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:18.142199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b19f6fa6-bd7c-4a04-bb76-06db31177d61 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.440340 Jun 18 05:20:18.142811 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 268/545] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:20:17 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:18.365352 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:18.366098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:18.375214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:18.375740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:18.379434 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:18.379434 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:18.397041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:18.593059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:18.601885 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ab4edf77-a0d4-4c8a-8bae-dfcb50e6ed61 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1757 microversion: 2.1 time: 0.241676 Jun 18 05:20:18.610314 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 278/546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:18 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:19.093345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:19.094133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:19.103444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:19.104024 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:19.104899 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:19.105370 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:19.302755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:19.311234 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c16968f4-0af9-48d1-aafe-975d523176bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.221967 Jun 18 05:20:19.312938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 269/547] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:19 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:20.275096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-d57e23c2-692a-4550-84f4-be6644b48fbf req-54bd1aca-b09b-49af-b31e-a109f9d6da88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdfd285-b389-41f4-9ec6-596c6b160f61", "name": "network-vif-plugged", "status": "completed", "tag": "1076f134-7839-4b58-b50b-1f994d3b47a5"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:20.281294 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-d57e23c2-692a-4550-84f4-be6644b48fbf req-54bd1aca-b09b-49af-b31e-a109f9d6da88 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:20.284344 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-d57e23c2-692a-4550-84f4-be6644b48fbf req-54bd1aca-b09b-49af-b31e-a109f9d6da88 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:20.307480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-d57e23c2-692a-4550-84f4-be6644b48fbf req-54bd1aca-b09b-49af-b31e-a109f9d6da88 service nova] Creating event network-vif-plugged:1076f134-7839-4b58-b50b-1f994d3b47a5 for instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 on hv-cinder-83699 Jun 18 05:20:20.323646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-d57e23c2-692a-4550-84f4-be6644b48fbf req-54bd1aca-b09b-49af-b31e-a109f9d6da88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048502 Jun 18 05:20:20.324635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 279/548] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:20.329354 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:20.336215 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:20.358351 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:20.373289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:20.374195 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:20.374644 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:20.703321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:20.724962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8dde39be-9525-4144-9f11-00beaf71fbe5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.399035 Jun 18 05:20:20.726452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 270/549] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:20 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:21.744219 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:21.744919 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:21.756500 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:21.758789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:21.759578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:21.760021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:21.951489 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:21.962746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0abfb510-96f5-4921-b3bf-b3948ebd248b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1371 microversion: 2.1 time: 0.223166 Jun 18 05:20:21.963211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 280/550] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:21 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:22.984937 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:22.985606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:22.992196 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:22.992874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:22.993676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:22.994117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:23.144731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:23.152300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bd68f83c-fa6f-40b7-aace-5b6c114332f5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1564 microversion: 2.1 time: 0.171335 Jun 18 05:20:23.152877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 271/551] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:22 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:23.170111 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:23.170608 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:23.177463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:23.184747 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:23.186015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:23.196386 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:23.297343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-507e98b8-ff28-4b5b-a122-f31c3ebf7ef7 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131132 Jun 18 05:20:23.298068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 281/552] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:20:23 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:24.412157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-bef77024-19d8-4355-a6bd-2c96962b93f0 req-5e0e9d50-3eff-48c5-88c9-634fa5e70a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdfd285-b389-41f4-9ec6-596c6b160f61", "tag": "1076f134-7839-4b58-b50b-1f994d3b47a5"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:24.426503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-bef77024-19d8-4355-a6bd-2c96962b93f0 req-5e0e9d50-3eff-48c5-88c9-634fa5e70a71 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:24.427049 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-bef77024-19d8-4355-a6bd-2c96962b93f0 req-5e0e9d50-3eff-48c5-88c9-634fa5e70a71 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:24.440182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-bef77024-19d8-4355-a6bd-2c96962b93f0 req-5e0e9d50-3eff-48c5-88c9-634fa5e70a71 service nova] Creating event network-changed:1076f134-7839-4b58-b50b-1f994d3b47a5 for instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 on hv-cinder-83699 Jun 18 05:20:24.445227 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-bef77024-19d8-4355-a6bd-2c96962b93f0 req-5e0e9d50-3eff-48c5-88c9-634fa5e70a71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037913 Jun 18 05:20:24.446940 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 272/553] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:28.114697 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:28.115291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:28.121927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:28.122372 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:28.123139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:28.123574 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:28.263093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lazy-loading 'services' on Instance uuid 240d96c6-c2da-4ee1-8fd9-554944f65d95 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:20:28.551502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c4c4d00b-a10c-4465-9c08-519b353286bf tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-volume_attachments/f8988565-d468-4656-94db-8a1c151a5fde" status: 202 len: 0 microversion: 2.1 time: 0.440908 Jun 18 05:20:28.555514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 282/554] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:20:28 2022] DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-volume_attachments/f8988565-d468-4656-94db-8a1c151a5fde => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:20:30.743705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=4 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:30.748886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c02a48a3-594d-49a3-a4fa-2c12aefeefe1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:30.756107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c02a48a3-594d-49a3-a4fa-2c12aefeefe1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:30.756781 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c02a48a3-594d-49a3-a4fa-2c12aefeefe1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:30.780861 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c02a48a3-594d-49a3-a4fa-2c12aefeefe1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Going to try to stop instance {{(pid=117990) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 05:20:30.928688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c02a48a3-594d-49a3-a4fa-2c12aefeefe1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action" status: 202 len: 0 microversion: 2.1 time: 0.186705 Jun 18 05:20:30.929831 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 273/555] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:20:30 2022] POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:20:30.938969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:30.940268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:30.947556 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:30.947982 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:30.948756 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:30.949187 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:31.091370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:31.100357 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e4eef571-40d8-448c-bf08-cff157136583 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.165722 Jun 18 05:20:31.101039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 283/556] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:30 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:32.118826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:32.120244 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:32.127164 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:32.127858 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:32.128661 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:32.129103 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:32.133239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:32.265023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:32.273456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-77f6eb0d-e60c-4c88-ad8a-62121edeb838 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.158844 Jun 18 05:20:32.274148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 274/557] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:32 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:33.291350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:33.292000 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:33.298996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:33.299562 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:33.300475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:33.301535 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:33.442355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:33.451304 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9d6f403b-7d75-4982-b2e1-0c07a1b77066 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.163773 Jun 18 05:20:33.452068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 284/558] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:33 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:34.469321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:34.469977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:34.478876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:34.479314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:34.480069 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:34.480579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:34.628249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:34.640499 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9e8947f4-c32b-4f1b-a1b7-54496862082d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.174853 Jun 18 05:20:34.645986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 275/559] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:34 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:35.659693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:35.660252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:35.674123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:35.674123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:35.674123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:35.674123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:35.808131 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:35.815616 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b8b63820-b447-466b-99c3-ffb084330105 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.159849 Jun 18 05:20:35.816196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 285/560] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:35 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:36.833901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:36.834643 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:36.837036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=42 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:36.841793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:36.842246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:36.843034 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:36.843492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:36.982246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:36.989944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-70b0c28a-0bdb-4f2d-9927-80c8269c7611 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.159933 Jun 18 05:20:36.990506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 276/561] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:36 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:38.008938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:38.009591 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:38.016360 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:38.016843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:38.017673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:38.018115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:38.155827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:38.164554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1c8c8675-4320-4c06-91a3-319bd326f646 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.160371 Jun 18 05:20:38.174349 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 286/562] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:38 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:39.182412 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:39.183061 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:39.189974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:39.190413 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:39.191166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:39.191595 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:39.334621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:39.342451 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a25f41be-12f6-4558-8695-eb678a437c4a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.165060 Jun 18 05:20:39.343038 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 277/563] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:39 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:40.361831 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:40.362547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:40.369785 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:40.370239 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:40.371018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:40.371453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:40.501217 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:40.509199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-21fb143b-bde1-4a9c-b358-665aa35b06b9 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.151158 Jun 18 05:20:40.516032 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 287/564] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:40 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:41.526612 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:41.527281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:41.533993 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:41.534442 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:41.535202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:41.535638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:41.691553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:41.691553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3ec41313-ba20-4a44-8201-c982dac7098e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.159698 Jun 18 05:20:41.691553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 278/565] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:41 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:42.700045 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:42.700654 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:42.707179 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:42.707622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:42.708444 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:42.708936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:42.841455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:42.846921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2974000e-90eb-4b07-866b-7c6595ad8759 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.150675 Jun 18 05:20:42.847480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 288/566] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:42 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:43.720595 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-542346089", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:43.771012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] validate_networks() for None {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:20:43.865133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:43.866765 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:43.872782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:43.873225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:43.874019 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:43.874451 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:44.005725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:44.013977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b1d85fa2-b104-49b3-85fb-4081f1b30d6d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.152705 Jun 18 05:20:44.014558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 289/567] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:43 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:44.039776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:20:44.040200 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:20:44.040670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:20:44.041109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:20:44.041560 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:20:44.050339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:44.050780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:44.051569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:44.051999 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:44.069506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Getting quotas for project e1242924d8394c81a19aa21cac3a8608. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:20:44.073434 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Getting quotas for user 40903900a6fc4959b315efe42ddd098d and project e1242924d8394c81a19aa21cac3a8608. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:20:44.084813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:20:44.087079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:20:44.248347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-15f8b06f-0865-4fca-8f39-36cc52f33d80 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531547 Jun 18 05:20:44.249014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 279/568] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:20:44.259037 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0cbbd357-f547-4237-b47f-16b00927bfbe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:44.259577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0cbbd357-f547-4237-b47f-16b00927bfbe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:44.311990 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0cbbd357-f547-4237-b47f-16b00927bfbe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:44.318609 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0cbbd357-f547-4237-b47f-16b00927bfbe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1214 microversion: 2.1 time: 0.063455 Jun 18 05:20:44.319370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 290/569] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:44 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:45.030951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:45.031596 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:45.038524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:45.042084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:45.042084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:45.042084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:45.336722 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:45.337525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:45.349261 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:45.349261 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:45.349261 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:45.349261 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:45.399653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:45.410369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bea9bbbc-b651-4c08-9430-45fee6f866b1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.383505 Jun 18 05:20:45.411036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 280/570] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:45 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:45.411161 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:45.419204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-05622dcf-57c0-4e52-b3d7-14d2e73e86c3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1218 microversion: 2.1 time: 0.087286 Jun 18 05:20:45.421863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 291/571] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:45 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:45.783120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1212089620", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-330640060", "security_groups": [{"name": "tempest-secgroup-smoke-1088067478"}], "block_device_mapping_v2": [{"uuid": "0472eee7-1c5d-47b6-ac58-689c18a17356", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1df631c6-dcd7-4307-8f3b-f75e299e78ec"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:45.893233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] validate_networks() for [('1df631c6-dcd7-4307-8f3b-f75e299e78ec', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:20:46.260952 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:20:46.261583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:20:46.261873 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:20:46.262285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:20:46.262699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:20:46.271443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:46.271969 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:46.272911 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:46.273510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:46.290729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:20:46.294600 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for user 6d24c8fbdc7246e2af87004f2985a9f5 and project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:20:46.352134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:20:46.354177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0472eee7-1c5d-47b6-ac58-689c18a17356',volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:20:46.427494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:46.428922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:46.435272 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:46.435713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:46.436470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:46.436923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:46.567146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:46.575958 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-aaf921e1-4bb2-49ee-b4d3-ef774135daeb tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1676 microversion: 2.1 time: 0.152283 Jun 18 05:20:46.576533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 292/572] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:46 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:46.587027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:46.587636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:46.593704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:46.594159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:46.594933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:46.595371 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:46.696990 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:46.705140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-53109b4e-a3f6-4af1-82e7-45a341d3bec2 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1274 microversion: 2.1 time: 0.127467 Jun 18 05:20:46.706621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 293/573] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:46 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:46.799441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-89349e70-ebe8-4a48-9209-1bf64eee32dc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.020381 Jun 18 05:20:46.804938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 281/574] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:20:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:20:46.823252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cd4e42d4-233d-43f5-b152-4494bf164620 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:46.826975 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cd4e42d4-233d-43f5-b152-4494bf164620 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:46.901245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-cd4e42d4-233d-43f5-b152-4494bf164620 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:46.909972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cd4e42d4-233d-43f5-b152-4494bf164620 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1094 microversion: 2.1 time: 0.099241 Jun 18 05:20:46.910630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 294/575] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:46 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:47.595024 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:47.600887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:47.603112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.603560 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:47.604325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.604765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:47.724032 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:47.724698 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:47.732794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.733236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:47.734024 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.734455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:47.743204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:47.751580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2feb65ed-e0cf-4801-ae0a-c273ae972a66 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1653 microversion: 2.1 time: 0.160291 Jun 18 05:20:47.752071 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 282/576] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:47 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:47.769188 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5162bf0f-9851-4f9c-b577-a1e8ad0be7b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:47.775690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5162bf0f-9851-4f9c-b577-a1e8ad0be7b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.776365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5162bf0f-9851-4f9c-b577-a1e8ad0be7b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:47.799399 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5162bf0f-9851-4f9c-b577-a1e8ad0be7b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Going to try to start instance {{(pid=117990) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 05:20:47.820201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:47.826704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-087354f1-c0d7-4148-8a4c-5920277b0de0 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1272 microversion: 2.1 time: 0.106823 Jun 18 05:20:47.827403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 295/577] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:47 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:47.926767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:47.927367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:47.929647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=44 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:47.937655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.937655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:47.937655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:47.937655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:48.010768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:48.014203 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5162bf0f-9851-4f9c-b577-a1e8ad0be7b5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action" status: 202 len: 0 microversion: 2.1 time: 0.248576 Jun 18 05:20:48.018736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 283/578] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:20:47 2022] POST /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:20:48.024839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0a851b9a-3918-4b70-9313-d0439ee21d48 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1144 microversion: 2.1 time: 0.101959 Jun 18 05:20:48.025614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 296/579] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:47 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:48.035381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:48.035381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:48.044869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:48.045579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:48.046661 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:48.048281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:48.198571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:48.207259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d7da5a58-5c69-48d4-852b-ee3b1061fe94 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1662 microversion: 2.1 time: 0.181224 Jun 18 05:20:48.207927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 284/580] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:48 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1662 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:48.844959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:48.845619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:48.853559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:48.854006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:48.854765 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:48.855197 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:48.859210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:49.031771 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-c608e892-7c5b-412f-bff0-783188b34750 req-f00ab6ee-9d44-45dc-9ed6-2f3aaae71899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25191347-555f-4f50-a0c8-e0ad960f1890", "tag": "09bdca09-5609-426c-9151-393b7ced1c72"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:49.048943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:49.057131 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-c608e892-7c5b-412f-bff0-783188b34750 req-f00ab6ee-9d44-45dc-9ed6-2f3aaae71899 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:49.058981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-c608e892-7c5b-412f-bff0-783188b34750 req-f00ab6ee-9d44-45dc-9ed6-2f3aaae71899 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:49.063959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ccb98b2d-ed58-4eaa-bb33-bd73c52a15a7 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.223573 Jun 18 05:20:49.064580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 297/581] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:48 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:49.074777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:49.082679 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:49.089096 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-c608e892-7c5b-412f-bff0-783188b34750 req-f00ab6ee-9d44-45dc-9ed6-2f3aaae71899 service nova] Creating event network-changed:09bdca09-5609-426c-9151-393b7ced1c72 for instance 25191347-555f-4f50-a0c8-e0ad960f1890 on hv-cinder-83699 Jun 18 05:20:49.096937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:49.098027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:49.099162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:49.100851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:49.112263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-c608e892-7c5b-412f-bff0-783188b34750 req-f00ab6ee-9d44-45dc-9ed6-2f3aaae71899 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077457 Jun 18 05:20:49.112263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 285/582] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:49.184555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:49.194576 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d836f502-9c09-4f5e-a7bb-9cfc22e73fec tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1192 microversion: 2.1 time: 0.126775 Jun 18 05:20:49.197969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 298/583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:49 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:49.228125 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:49.228849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:49.236017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:49.236519 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:49.237298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:49.237741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:49.380618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:49.389102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-db8eebee-0b91-4490-bd4e-1a6723d73c0b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1662 microversion: 2.1 time: 0.166825 Jun 18 05:20:49.389723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 286/584] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:49 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:50.082235 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:50.082843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:50.090125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:50.090576 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:50.091338 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:50.091770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:50.212912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:50.213554 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:50.219416 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:50.219860 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:50.220618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:50.221044 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:50.222179 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:50.230247 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-176c4fc7-7235-4799-9574-abe10fbecdf4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.152196 Jun 18 05:20:50.230814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 299/585] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:50 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:50.406609 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:50.407132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:50.414079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:50.414766 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:50.415543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:50.415979 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:50.463000 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:50.471113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6e9c2adb-6016-4f91-b4cf-0ecccaef9371 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1278 microversion: 2.1 time: 0.263351 Jun 18 05:20:50.471784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 287/586] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:50 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:50.596957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:50.607504 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fb29608f-9ba0-40c4-b752-10e2c94b1c37 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1666 microversion: 2.1 time: 0.205390 Jun 18 05:20:50.608092 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 300/587] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:50 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:51.247819 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:51.248618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:51.258192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:51.258192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:51.258192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:51.258192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:51.430466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:51.446408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d0b9547b-d7a6-44ef-9fea-46756a782901 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.195086 Jun 18 05:20:51.446408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 288/588] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:51 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:51.446873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-3fa32570-563d-40f0-b68e-809e41c8efa9 req-48ef9be0-67d2-4245-9b95-3910b56d3d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0862f974-0f40-4c61-95a9-9c0e1db65a4b", "tag": "23c6b7c7-2045-4a84-955e-c924bc121496"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:51.454864 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-3fa32570-563d-40f0-b68e-809e41c8efa9 req-48ef9be0-67d2-4245-9b95-3910b56d3d33 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:51.455305 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-3fa32570-563d-40f0-b68e-809e41c8efa9 req-48ef9be0-67d2-4245-9b95-3910b56d3d33 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:51.469304 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-3fa32570-563d-40f0-b68e-809e41c8efa9 req-48ef9be0-67d2-4245-9b95-3910b56d3d33 service nova] Creating event network-changed:23c6b7c7-2045-4a84-955e-c924bc121496 for instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b on hv-cinder-83699 Jun 18 05:20:51.474373 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-3fa32570-563d-40f0-b68e-809e41c8efa9 req-48ef9be0-67d2-4245-9b95-3910b56d3d33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034567 Jun 18 05:20:51.475577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 301/589] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:20:51.488392 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:51.489011 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:51.495473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:51.495947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:51.496722 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:51.497328 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:51.637701 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:51.645182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-47737ad2-bcd9-4702-9b65-5dd3fcae69b7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1278 microversion: 2.1 time: 0.161009 Jun 18 05:20:51.645889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 289/590] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:51 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:52.460500 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:52.461206 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:52.467503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:52.467947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:52.468814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:52.469190 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:52.664351 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:52.665073 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:52.672808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:52.673576 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:52.677477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:52.682243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:52.685926 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:52.688384 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7ae56046-d8bb-4449-8f1c-87a29186c39e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.232858 Jun 18 05:20:52.694320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 302/591] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:52 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:52.901316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:52.909933 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-89d0ccec-a966-4241-92c7-1ee97224668e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1278 microversion: 2.1 time: 0.250324 Jun 18 05:20:52.910509 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 290/592] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:52 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:53.710360 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:53.710960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:53.717744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:53.718185 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:53.718938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:53.719366 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:53.852354 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:53.859735 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-64e526b3-9f0f-4f01-9e37-607b8e73c8a4 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.153917 Jun 18 05:20:53.860521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 303/593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:53 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:53.926403 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:53.927032 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:53.933705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:53.934156 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:53.934940 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:53.935373 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.068623 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:54.071949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:54.078835 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-61554764-350b-40e7-ba53-d7be175296ab tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.156351 Jun 18 05:20:54.083385 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 291/594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:53 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:54.455433 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:54.455845 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:54.462502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:54.462943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.463748 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:54.464177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.492689 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f2f24fd4-d6a3-40df-acc0-2d474e2c65cb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments/530eb45d-703c-4532-ba98-7ca49f733b33" status: 200 len: 194 microversion: 2.20 time: 0.041218 Jun 18 05:20:54.493280 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 304/595] 10.222.0.23 () {60 vars in 1453 bytes} [Sat Jun 18 05:20:54 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments/530eb45d-703c-4532-ba98-7ca49f733b33 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 05:20:54.558289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:54.558810 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:54.565158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:54.565625 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.566384 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:54.566887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.695703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lazy-loading 'services' on Instance uuid 3db86af8-06be-4481-ae05-85abb634d58e {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:20:54.876131 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:54.876855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:54.886523 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:54.887137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.887945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:54.888420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:54.979238 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dcd72c61-0d77-4e83-af30-044dba51e281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments/530eb45d-703c-4532-ba98-7ca49f733b33" status: 202 len: 0 microversion: 2.20 time: 0.425240 Jun 18 05:20:54.979840 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 292/596] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Jun 18 05:20:54 2022] DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments/530eb45d-703c-4532-ba98-7ca49f733b33 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:20:54.989364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:54.990607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:54.998030 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:55.001197 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:55.001197 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:55.001197 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:55.019669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:55.027940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ff6ee578-1cc0-4a27-be4e-4688ea7f3046 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.155596 Jun 18 05:20:55.028528 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 305/597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:54 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:55.032376 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-66e4bcbc-626e-4b3f-bfbb-cfab13d6a9ae tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048035 Jun 18 05:20:55.032929 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 293/598] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 05:20:54 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 05:20:55.097607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:55.098771 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:55.105057 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:55.105534 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:55.106287 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:55.106713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:55.246821 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:55.254176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d5037ab4-72cf-4870-971b-2698813c4e12 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.160542 Jun 18 05:20:55.254737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 306/599] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:55 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:56.044492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:56.045154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:56.045685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:56.045772 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:56.052388 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.052620 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.052897 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.053580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.053764 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.054205 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.054371 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.055137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.085496 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0cf51e6d-2238-4fde-bfbb-7dd72817808b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044934 Jun 18 05:20:56.086097 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 294/600] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 05:20:56 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:20:56.225165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:56.238157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c60fe6ed-98ce-478f-8215-9cbff9a9af39 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.197444 Jun 18 05:20:56.239705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 307/601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:56 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:56.273630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:56.274258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:56.279660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-e9a6be20-2a55-4973-b5b5-d47f4e6c6fc5 req-edff3bb5-e735-431e-9d7e-ff79e520c756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25191347-555f-4f50-a0c8-e0ad960f1890", "name": "network-vif-plugged", "status": "completed", "tag": "09bdca09-5609-426c-9151-393b7ced1c72"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:20:56.285137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=4 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:56.285137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.285137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.285137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.285997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.290590 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-e9a6be20-2a55-4973-b5b5-d47f4e6c6fc5 req-edff3bb5-e735-431e-9d7e-ff79e520c756 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:56.291068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-e9a6be20-2a55-4973-b5b5-d47f4e6c6fc5 req-edff3bb5-e735-431e-9d7e-ff79e520c756 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:56.303270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=12 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:56.305114 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-e9a6be20-2a55-4973-b5b5-d47f4e6c6fc5 req-edff3bb5-e735-431e-9d7e-ff79e520c756 service nova] Creating event network-vif-plugged:09bdca09-5609-426c-9151-393b7ced1c72 for instance 25191347-555f-4f50-a0c8-e0ad960f1890 on hv-cinder-83699 Jun 18 05:20:56.310264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-e9a6be20-2a55-4973-b5b5-d47f4e6c6fc5 req-edff3bb5-e735-431e-9d7e-ff79e520c756 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Jun 18 05:20:56.314396 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 308/602] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:20:56.447456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:56.454793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3e77d457-9a08-45d4-a2aa-e483b63b8cc5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.186989 Jun 18 05:20:56.455347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 295/603] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:56 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:57.102123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:20:57.106752 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:57.107913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:57.114597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.114597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.115974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.116406 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.144775 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bfb90e91-ef5d-4ffc-9cd9-f8a00994996a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043682 Jun 18 05:20:57.145321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 309/604] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 05:20:57 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:57.204814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:57.205351 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:57.213565 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.214016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.214779 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.215213 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.240031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:20:57.257559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:57.258169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:57.264062 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.264963 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.265239 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.265694 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.399782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:57.407584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-584f7fc6-006e-4d1e-a872-bbd4eccb67ac tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.155076 Jun 18 05:20:57.408861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 310/605] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:57 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:57.472029 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:57.472623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:57.479279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.483467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.483467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.483467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.483838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6066a66f-867a-44dc-85b9-c4304d5e525c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 204 len: 0 microversion: 2.20 time: 0.280115 Jun 18 05:20:57.483838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 296/606] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 05:20:57 2022] DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 05:20:57.490504 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:57.491199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:57.497544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.497992 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.498752 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:57.499181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:57.614515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:57.622081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ddd04e23-1b68-494b-8192-b26baf34176c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.153893 Jun 18 05:20:57.622728 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 311/607] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:57 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:20:57.643646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:57.652006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:57.653558 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:57.658347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4a881a7c-885c-4d77-872e-c7c109c2cb3e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.168797 Jun 18 05:20:57.658347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 297/608] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:20:57 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:20:58.425350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:58.425984 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:58.432551 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:58.433018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:58.433786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:58.434225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:58.563644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:58.571449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fde9a3e7-0fbf-47d0-9199-91329a19d700 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.150010 Jun 18 05:20:58.572003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 312/609] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:58 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:58.640364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:58.640970 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:58.648058 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:58.648510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:58.649269 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:58.649738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:58.675093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:58.675694 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:58.682886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:58.683327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:58.684080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:58.684505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:58.779510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:58.787519 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6db42855-ce75-4a11-a8fa-b90dcfeec0e4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.150372 Jun 18 05:20:58.788794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 298/610] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:58 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:58.812909 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:58.820793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:58.822296 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:58.823454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5092fb76-0df2-4d16-942b-f24ef69245eb tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.152192 Jun 18 05:20:58.824009 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 313/611] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:20:58 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:20:59.588147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:59.588688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:59.594811 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:59.595257 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:59.596018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:59.596456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:59.727118 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:59.734789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5d08ff1a-6789-40ba-9b2a-b61420135dfe tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1314 microversion: 2.1 time: 0.150665 Jun 18 05:20:59.735352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 299/612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:59 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:59.804111 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:59.804725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:59.811292 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:59.811743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:59.812507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:59.812941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:59.842146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:20:59.842671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:20:59.848599 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:59.849046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:59.850813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:20:59.851249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:20:59.942752 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:59.950723 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9db059a1-9842-4cf4-a17c-9416f1c9159d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.150609 Jun 18 05:20:59.951299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 314/613] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:20:59 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:20:59.982479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:59.990338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:59.991836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:20:59.992997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ec59955f-5526-415f-8e79-6754e43eac7b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.154788 Jun 18 05:20:59.993577 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 300/614] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:20:59 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:21:00.752384 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:00.752985 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:00.759221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:00.759660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:00.760409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:00.760858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:00.763394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:00.892864 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:00.900719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-de5c5685-e228-4096-b911-439005e7356b tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1464 microversion: 2.1 time: 0.152289 Jun 18 05:21:00.901280 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 315/615] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:00 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:00.940713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:00.941239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:00.947898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:00.948348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:00.949112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:00.949585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:00.967798 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:00.968403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:00.973985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:21:00.974983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:00.975437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:00.976198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:00.976628 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:01.107085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:01.114494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3cd81d46-4d59-4131-bb10-6ed981790c09 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.150447 Jun 18 05:21:01.116349 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 316/616] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:00 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:01.120679 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:01.121283 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:01.127002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:01.127772 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:01.128324 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:01.128758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:01.243036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-318be64c-5dc4-4e9f-bbf1-6ad9a7213c20 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 204 len: 0 microversion: 2.1 time: 0.305887 Jun 18 05:21:01.243641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 301/617] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:21:00 2022] DELETE /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:21:01.252253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:01.258763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:01.259304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:01.259751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:01.260523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:01.260951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:01.264036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:01.274020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:01.275607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:01.277070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c4485970-1959-44b4-93ab-00e691d7beac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1723 microversion: 2.20 time: 0.159915 Jun 18 05:21:01.281443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 317/618] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:01 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:01.499783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:01.508960 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ca341612-ee37-4133-acdf-8727fa1708d3 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1470 microversion: 2.1 time: 0.260809 Jun 18 05:21:01.509569 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 302/619] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:01 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:02.132030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:02.132645 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:02.139193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.140582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.140582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.140938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.282038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:02.291811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b339e39e-8d1f-48c6-ad58-3b377f2b2c80 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.163457 Jun 18 05:21:02.292486 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 318/620] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:02 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:02.297451 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:02.298024 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:02.305147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.305698 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.306849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.307443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.384094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:02.393174 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:02.394655 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:02.395857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-685b4784-c8ee-44f5-8dd5-e511afeb5d54 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1655 microversion: 2.20 time: 0.103147 Jun 18 05:21:02.396421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 303/621] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:02 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:21:02.497853 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-476069fe-7a7f-40bc-a605-a6ae433970bf req-23072e5a-baf3-4992-a43d-10e0d8c2cfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db86af8-06be-4481-ae05-85abb634d58e", "name": "network-vif-deleted", "tag": "1fb70483-13da-4dd6-a45d-5224ec85a411"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:02.506417 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-476069fe-7a7f-40bc-a605-a6ae433970bf req-23072e5a-baf3-4992-a43d-10e0d8c2cfe9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.506891 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-476069fe-7a7f-40bc-a605-a6ae433970bf req-23072e5a-baf3-4992-a43d-10e0d8c2cfe9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.519482 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-476069fe-7a7f-40bc-a605-a6ae433970bf req-23072e5a-baf3-4992-a43d-10e0d8c2cfe9 service nova] Creating event network-vif-deleted:1fb70483-13da-4dd6-a45d-5224ec85a411 for instance 3db86af8-06be-4481-ae05-85abb634d58e on hv-cinder-83699 Jun 18 05:21:02.524819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-476069fe-7a7f-40bc-a605-a6ae433970bf req-23072e5a-baf3-4992-a43d-10e0d8c2cfe9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Jun 18 05:21:02.525443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 319/622] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:02.527040 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:02.527726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:02.533997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.534431 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.535190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:02.535664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:02.551440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:02.694776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:02.703869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-39d3197a-23c1-4c78-946c-36da9281e0d1 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1470 microversion: 2.1 time: 0.181452 Jun 18 05:21:02.704464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 304/623] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:02 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:03.309630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:03.310660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:03.319046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.319829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.320922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.324906 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.416189 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:03.416790 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:03.426345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:03.428099 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.429471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.429747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.430345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.475740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:03.484386 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-de68b3b4-2f4e-4f98-af0a-a6fc0c367c0d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.179438 Jun 18 05:21:03.485776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 320/624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:03 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:03.507594 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.509273 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.513200 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lazy-loading 'fault' on Instance uuid 3db86af8-06be-4481-ae05-85abb634d58e {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:21:03.663467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:03.682888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:03.684379 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:03.685579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-530216e7-4cc4-4e19-96e4-4a6d01f713b3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 200 len: 1371 microversion: 2.20 time: 0.275042 Jun 18 05:21:03.710414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 305/625] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:03 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:21:03.722338 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:03.722947 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:03.740273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.740650 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.741446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:03.742053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:03.814397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40903900a6fc4959b315efe42ddd098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1242924d8394c81a19aa21cac3a8608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:03.822920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-72636ad1-2460-433c-ad71-643b13e764d9 tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 200 len: 1428 microversion: 2.1 time: 0.104443 Jun 18 05:21:03.823492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 321/626] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:03 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:04.502383 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:04.503029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:04.510212 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.510660 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.511413 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.511846 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.539234 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-5531a12d-01f3-4611-a9f2-0f359a7f9b71 req-bcfc46f4-7be3-4657-866c-4222acf98b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25191347-555f-4f50-a0c8-e0ad960f1890", "name": "network-vif-deleted", "tag": "09bdca09-5609-426c-9151-393b7ced1c72"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:04.556053 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-5531a12d-01f3-4611-a9f2-0f359a7f9b71 req-bcfc46f4-7be3-4657-866c-4222acf98b50 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.561442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-5531a12d-01f3-4611-a9f2-0f359a7f9b71 req-bcfc46f4-7be3-4657-866c-4222acf98b50 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.573402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-5531a12d-01f3-4611-a9f2-0f359a7f9b71 req-bcfc46f4-7be3-4657-866c-4222acf98b50 service nova] Creating event network-vif-deleted:09bdca09-5609-426c-9151-393b7ced1c72 for instance 25191347-555f-4f50-a0c8-e0ad960f1890 on hv-cinder-83699 Jun 18 05:21:04.578201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-5531a12d-01f3-4611-a9f2-0f359a7f9b71 req-bcfc46f4-7be3-4657-866c-4222acf98b50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042710 Jun 18 05:21:04.579008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 322/627] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:21:04.667660 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:04.675462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c2c1dcf1-be4b-453d-b1b4-571f2905012e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.177440 Jun 18 05:21:04.676121 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 306/628] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:04 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:04.713835 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:04.714972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:04.721233 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.725782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.725782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.725782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.736793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] HTTP exception thrown: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Request method failure captured: Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e HTTP/1.1 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-6UTMfRwTaSNYnxWMUh0XY444wsVOavr6__ryX2jxMDL0Dgrhi5nxgeT_COG_Bxy0u6j_HDC7he36s36IlUkLywrpEoM9AzbqZEW7eZIZX_PvTEAZ2weVZNj4ScmAdJnQlzvhX1qWxTA0pXOSESe9lFsd6QK9kP3rju9KNdovXMUo Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:21:04.738525 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/758883a5aea04c85ad65bb6970bdb098"}]}] Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e0f3999a062e45748878a3204e3ea456 Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:21:04.740533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '3db86af8-06be-4481-ae05-85abb634d58e'} Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:21:04.741415 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:21:04.742934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.744297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Returning 404 to user: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:21:04.744297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1025e998-8bd2-43cd-82a1-529d4be7801d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 404 len: 111 microversion: 2.20 time: 0.030715 Jun 18 05:21:04.744297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 323/629] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:04 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:21:04.750870 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bf882aa8-02c7-426e-85da-09a2d10561d0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '.version_select at 0x7f7b02190790>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:04.815727 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bf882aa8-02c7-426e-85da-09a2d10561d0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093710094" status: 204 len: 0 microversion: 2.20 time: 0.069783 Jun 18 05:21:04.819347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 307/630] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Jun 18 05:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093710094 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 05:21:04.841865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:04.841865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] [instance: 25191347-555f-4f50-a0c8-e0ad960f1890] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:04.848329 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.848812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.850381 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:04.851016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:04.866516 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] HTTP exception thrown: Instance 25191347-555f-4f50-a0c8-e0ad960f1890 could not be found. Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Request method failure captured: Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 HTTP/1.1 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWCpSOEfSpwO9SvW_XbKvJGzYWbn8lBKTfsqpHuw40zEOc5GkQiIBNqXDvT_ZDBw8mV1aMr3sHHr4ZM06t2EvclD-ezvIaeOQ4B4bBSyMjrlwQp9qT4tuI6Zg0tVZApKt_KQEimj8DsGPsAydMdgBZnlFHByDaqSxvh_Wiu4acmvPr0 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: e1242924d8394c81a19aa21cac3a8608 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesNegativeTest-438707663 Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:21:04.868198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1242924d8394c81a19aa21cac3a8608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1242924d8394c81a19aa21cac3a8608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e1242924d8394c81a19aa21cac3a8608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e1242924d8394c81a19aa21cac3a8608"}]}] Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesNegativeTest-438707663 Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: e1242924d8394c81a19aa21cac3a8608 Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesNegativeTest-438707663 Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesNegativeTest-438707663-project Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 40903900a6fc4959b315efe42ddd098d Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesNegativeTest-438707663-project Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 25191347-555f-4f50-a0c8-e0ad960f1890 could not be found. Jun 18 05:21:04.869573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '25191347-555f-4f50-a0c8-e0ad960f1890'} Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25191347-555f-4f50-a0c8-e0ad960f1890 could not be found. Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:21:04.870332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25191347-555f-4f50-a0c8-e0ad960f1890 could not be found. Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25191347-555f-4f50-a0c8-e0ad960f1890 could not be found. Jun 18 05:21:04.871485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:04.873550 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] Returning 404 to user: Instance 25191347-555f-4f50-a0c8-e0ad960f1890 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:21:04.874406 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-534b73d6-544b-4e1d-8820-c6a782417a7e tempest-VolumesNegativeTest-438707663 tempest-VolumesNegativeTest-438707663-project] 10.222.0.23 "GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890" status: 404 len: 111 microversion: 2.1 time: 0.037997 Jun 18 05:21:04.874964 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 324/631] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:04 2022] GET /compute/v2.1/servers/25191347-555f-4f50-a0c8-e0ad960f1890 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:21:05.649879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-77358556-865c-4855-a386-6f2bf5b3dd79 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'create', calling method: .version_select at 0x7f7b01528a60>, body: {"keypair": {"name": "tempest-keypair-1929894634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgI23d8+4PKF+J6ORQmeWADj1Yf1fx72vGGy61M0aQZnxpwa8KgOtpRnyrI6aJvAr+nRP36dUENs1/XHtbMwrGyVFZJnd2l1vgOK/oHONJCv69nGFiZV5FfjtXlxrWc3g=="}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:05.667267 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-77358556-865c-4855-a386-6f2bf5b3dd79 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for project 758883a5aea04c85ad65bb6970bdb098. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:21:05.671243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-77358556-865c-4855-a386-6f2bf5b3dd79 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for user e0f3999a062e45748878a3204e3ea456 and project 758883a5aea04c85ad65bb6970bdb098. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:21:05.692442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:05.693824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:05.699708 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:05.700154 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:05.700903 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:05.701334 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:05.807706 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-77358556-865c-4855-a386-6f2bf5b3dd79 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.162771 Jun 18 05:21:05.808871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 308/632] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Jun 18 05:21:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 05:21:05.845751 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:05.854187 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-32bdfe90-8786-466c-aaba-247ec4ffd45f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.165530 Jun 18 05:21:05.854841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 325/633] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:05 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:06.409192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-8552213f-86ed-4270-b531-313894554520 req-81891bd5-50ab-46b9-ac39-b225b9a61a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0862f974-0f40-4c61-95a9-9c0e1db65a4b", "name": "network-vif-plugged", "status": "completed", "tag": "23c6b7c7-2045-4a84-955e-c924bc121496"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:06.419844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8552213f-86ed-4270-b531-313894554520 req-81891bd5-50ab-46b9-ac39-b225b9a61a76 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:06.419844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8552213f-86ed-4270-b531-313894554520 req-81891bd5-50ab-46b9-ac39-b225b9a61a76 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:06.432018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-8552213f-86ed-4270-b531-313894554520 req-81891bd5-50ab-46b9-ac39-b225b9a61a76 service nova] Creating event network-vif-plugged:23c6b7c7-2045-4a84-955e-c924bc121496 for instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b on hv-cinder-83699 Jun 18 05:21:06.437492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-8552213f-86ed-4270-b531-313894554520 req-81891bd5-50ab-46b9-ac39-b225b9a61a76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Jun 18 05:21:06.438387 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 309/634] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:06.871127 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:06.871746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:06.878240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:06.878731 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:06.879503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:06.879938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:07.023637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:07.031373 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e4cf4373-9414-41f7-b1bd-a7de0af18cc4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.164106 Jun 18 05:21:07.031928 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 326/635] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:06 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:08.049140 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:08.050166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:08.056857 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:08.057298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:08.058263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:08.058692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:08.203743 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:08.214135 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-360f792f-06a8-4871-9aca-8f83412048f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1266 microversion: 2.1 time: 0.169605 Jun 18 05:21:08.215657 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 310/636] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:08 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:08.238099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-581190904", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7ef077f-c52c-4f70-b85e-e8892706babc"}], "security_groups": [{"name": "tempest-securitygroup--699361790"}], "key_name": "tempest-keypair-1929894634", "user_data": "}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:08.341016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] validate_networks() for [('f7ef077f-c52c-4f70-b85e-e8892706babc', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:21:08.726814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:21:08.727266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:21:08.727770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:21:08.728181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:21:08.728597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:21:08.738299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:08.738748 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:08.740058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:08.740483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:08.757904 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for project 758883a5aea04c85ad65bb6970bdb098. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:21:08.762013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Getting quotas for user e0f3999a062e45748878a3204e3ea456 and project 758883a5aea04c85ad65bb6970bdb098. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:21:08.773123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:21:08.775419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:21:08.928705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cec59a05-d70e-4f0b-9684-3f9dfe8a3dca tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.695045 Jun 18 05:21:08.929353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 327/637] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Jun 18 05:21:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 05:21:08.939416 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-de532cfd-1a95-45d6-b9ea-51462070b77e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:08.940024 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-de532cfd-1a95-45d6-b9ea-51462070b77e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:09.010023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-de532cfd-1a95-45d6-b9ea-51462070b77e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:09.017912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-de532cfd-1a95-45d6-b9ea-51462070b77e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:09.019487 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-de532cfd-1a95-45d6-b9ea-51462070b77e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:09.020850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-de532cfd-1a95-45d6-b9ea-51462070b77e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1281 microversion: 2.20 time: 0.085402 Jun 18 05:21:09.022312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 311/638] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:08 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:09.233675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:09.234288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:09.244783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:09.244783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:09.244783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:09.244783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:09.400989 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:09.409075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f039bc3f-9a93-4b36-b3f9-4ad5a1b66cf4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1454 microversion: 2.1 time: 0.180936 Jun 18 05:21:09.409673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 328/639] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:09 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:09.434823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:09.435446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:09.445780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:09.446481 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:09.447281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:09.447722 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:09.583974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:09.592576 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-affe9701-4d97-48c1-b76d-641526cefad6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1454 microversion: 2.1 time: 0.165588 Jun 18 05:21:09.593145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 312/640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:09 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:10.040289 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:10.040987 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:10.047017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:10.047463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:10.048223 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:10.048656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:10.118293 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:10.126901 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:10.128430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:10.129587 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6e538cc3-b2b2-47bb-aee3-50836dbb9c29 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1285 microversion: 2.20 time: 0.093270 Jun 18 05:21:10.130782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 329/641] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:10 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:10.333259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1758100460"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:10.333819 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:10.339942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:10.340390 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:10.341151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:10.341630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:10.582760 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.network.security_group_api [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Removing security group 131710a9-3157-4597-bd4b-a4a60c8f2d5b from port ed5753b8-9359-4e81-8f42-c2dd469ec79e Jun 18 05:21:11.148938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:11.149570 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:11.156512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:11.156966 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:11.157767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:11.158217 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:11.232190 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:11.241446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:11.242972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:11.244192 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b183b960-cc43-4fb5-b15f-9d7791d53992 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1341 microversion: 2.20 time: 0.099745 Jun 18 05:21:11.244757 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 330/642] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:11 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:21:11.400729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e430e1b1-d3e1-4e4a-a694-035c43206e7d tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/action" status: 202 len: 0 microversion: 2.1 time: 1.070847 Jun 18 05:21:11.401523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 313/643] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:21:10 2022] POST /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/action => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:21:11.413253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-0dbe34f9-7948-42ac-b01f-c59cff5db01c req-c0694367-6402-430d-8ec2-621866f32c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:11.426340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0dbe34f9-7948-42ac-b01f-c59cff5db01c req-c0694367-6402-430d-8ec2-621866f32c0b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:11.426792 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0dbe34f9-7948-42ac-b01f-c59cff5db01c req-c0694367-6402-430d-8ec2-621866f32c0b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:11.459706 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-0dbe34f9-7948-42ac-b01f-c59cff5db01c req-c0694367-6402-430d-8ec2-621866f32c0b service nova] Creating event network-changed:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:21:11.471390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-0dbe34f9-7948-42ac-b01f-c59cff5db01c req-c0694367-6402-430d-8ec2-621866f32c0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061799 Jun 18 05:21:11.473002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 331/644] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:12.263686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:12.265342 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:12.273943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:12.274395 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:12.275184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:12.275621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:12.412178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:12.424440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:12.426015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:12.428544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e2f0d98a-6819-45e8-9931-2d41bebd15a5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1339 microversion: 2.20 time: 0.168254 Jun 18 05:21:12.428751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 314/645] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:12 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:13.467665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:13.467665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:13.477320 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:13.477806 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:13.478592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:13.479035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:13.518480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:13.519107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:13.530364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:13.533862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:13.536445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:13.536445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:13.692785 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:13.702671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:13.706303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:13.706303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3fd9af6a-164b-4ae6-a34d-bce3a2342667 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.247420 Jun 18 05:21:13.716779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 332/646] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:13 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:13.722561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-4f35a0b5-afdb-4197-be30-2dd3302809b9 req-c57ddde6-bc1f-4af8-baf0-86ea80c72f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:13.725269 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lazy-loading 'services' on Instance uuid bf8c3731-ba5b-41dc-ab3b-16d6725300a0 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:21:13.732043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-4f35a0b5-afdb-4197-be30-2dd3302809b9 req-c57ddde6-bc1f-4af8-baf0-86ea80c72f64 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:13.732744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-4f35a0b5-afdb-4197-be30-2dd3302809b9 req-c57ddde6-bc1f-4af8-baf0-86ea80c72f64 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:13.755558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-4f35a0b5-afdb-4197-be30-2dd3302809b9 req-c57ddde6-bc1f-4af8-baf0-86ea80c72f64 service nova] Creating event network-changed:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:21:13.769726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-4f35a0b5-afdb-4197-be30-2dd3302809b9 req-c57ddde6-bc1f-4af8-baf0-86ea80c72f64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051378 Jun 18 05:21:13.770550 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 333/647] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:13.779630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-f4d7b5ee-4a75-4008-860c-cca82067fa15 req-d8b4a132-b2fd-46e8-a1e9-730f7ac1916c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0862f974-0f40-4c61-95a9-9c0e1db65a4b", "tag": "23c6b7c7-2045-4a84-955e-c924bc121496"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:13.789496 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-f4d7b5ee-4a75-4008-860c-cca82067fa15 req-d8b4a132-b2fd-46e8-a1e9-730f7ac1916c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:13.790325 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-f4d7b5ee-4a75-4008-860c-cca82067fa15 req-d8b4a132-b2fd-46e8-a1e9-730f7ac1916c service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:13.803858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-f4d7b5ee-4a75-4008-860c-cca82067fa15 req-d8b4a132-b2fd-46e8-a1e9-730f7ac1916c service nova] Creating event network-changed:23c6b7c7-2045-4a84-955e-c924bc121496 for instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b on hv-cinder-83699 Jun 18 05:21:13.821139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-f4d7b5ee-4a75-4008-860c-cca82067fa15 req-d8b4a132-b2fd-46e8-a1e9-730f7ac1916c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045956 Jun 18 05:21:13.822965 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 334/648] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:14.003485 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ec3ef64d-ba57-4990-af0a-23ccddba5ef8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments/de11020e-f5e4-4137-9d15-1d1ce1a89cf0" status: 202 len: 0 microversion: 2.1 time: 0.488722 Jun 18 05:21:14.006183 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 315/649] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:21:13 2022] DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments/de11020e-f5e4-4137-9d15-1d1ce1a89cf0 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:21:14.025695 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:14.029036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:14.045042 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:14.046076 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:14.047910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:14.057794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:14.187667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d511cd26-aa13-4293-b34f-64d894505edf tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174653 Jun 18 05:21:14.188851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 335/650] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:21:14 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:14.725646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:14.727186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:14.736057 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:14.736914 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:14.738004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:14.738796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:14.949374 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:14.958682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:14.960243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:14.961368 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8f64f95b-2aca-4039-8291-66179b30f075 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.241569 Jun 18 05:21:14.962047 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 316/651] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:14 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:15.200121 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:15.201033 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:15.215059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:15.215502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:15.216390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:15.216827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:15.272536 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-86969090-91ad-4376-b466-b6982f58809f tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075653 Jun 18 05:21:15.273529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 336/652] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:21:15 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:15.842795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-712a0356-be3a-473b-a0bb-56d3b08c4ac4 req-53d04ee6-584f-426d-a0be-95ea75996592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:15.851441 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-712a0356-be3a-473b-a0bb-56d3b08c4ac4 req-53d04ee6-584f-426d-a0be-95ea75996592 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:15.851876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-712a0356-be3a-473b-a0bb-56d3b08c4ac4 req-53d04ee6-584f-426d-a0be-95ea75996592 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:15.862575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-712a0356-be3a-473b-a0bb-56d3b08c4ac4 req-53d04ee6-584f-426d-a0be-95ea75996592 service nova] Creating event network-changed:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:21:15.867631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-712a0356-be3a-473b-a0bb-56d3b08c4ac4 req-53d04ee6-584f-426d-a0be-95ea75996592 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028460 Jun 18 05:21:15.868210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 317/653] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:15.978781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:15.979407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:15.985400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:15.985882 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:15.986639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:15.987071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:15.991109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:16.116938 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:16.124791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:16.126312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:16.127404 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e9d50297-227d-43e8-9168-0402c3612699 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.152597 Jun 18 05:21:16.127956 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 337/654] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:15 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:16.285016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:16.286072 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:16.292453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:16.292896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:16.293691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:16.294123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:16.322662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d0e9b763-3153-4c78-b8aa-70665ebb3dfc tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042163 Jun 18 05:21:16.323213 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 318/655] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:21:16 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:21:16.333439 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:16.334220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:16.336520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:16.341198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:16.341675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:16.342428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:16.342923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:16.418587 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] HTTP exception thrown: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 is not attached to volume de11020e-f5e4-4137-9d15-1d1ce1a89cf0 Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Request method failure captured: Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments/de11020e-f5e4-4137-9d15-1d1ce1a89cf0 HTTP/1.1 Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWADb7vlF9-qd20obWz_rCtm9FgKjRmVIURXVVBk4FMimxU3lUiGy9mL-ib3PH0Cr36JbYjy1TkkyYiLbEf9k0I9qjlYN01Tvtp8AfoqAhyJK13y16qWCesaJGDYcG9-aLjhjVcrvfptAXFnsVOK4f8bt2yxRzlgQC_B9wxHOGOMPbE Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 3a833f00ba294564a66b9eefbc49147e Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-TestMinimumBasicScenario-1360665084 Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:21:16.424623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a833f00ba294564a66b9eefbc49147e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a833f00ba294564a66b9eefbc49147e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3a833f00ba294564a66b9eefbc49147e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3a833f00ba294564a66b9eefbc49147e"}]}] Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-TestMinimumBasicScenario-1360665084 Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 3a833f00ba294564a66b9eefbc49147e Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1360665084 Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-TestMinimumBasicScenario-1360665084-project Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 113fba3872764b02bcbcc69299d8768f Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-TestMinimumBasicScenario-1360665084-project Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:21:16.426278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 is not attached to volume de11020e-f5e4-4137-9d15-1d1ce1a89cf0 Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'server_id': 'bf8c3731-ba5b-41dc-ab3b-16d6725300a0', 'id': 'de11020e-f5e4-4137-9d15-1d1ce1a89cf0'} Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id de11020e-f5e4-4137-9d15-1d1ce1a89cf0. Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:21:16.427639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 is not attached to volume de11020e-f5e4-4137-9d15-1d1ce1a89cf0 Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 is not attached to volume de11020e-f5e4-4137-9d15-1d1ce1a89cf0 Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:16.428924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Returning 404 to user: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 is not attached to volume de11020e-f5e4-4137-9d15-1d1ce1a89cf0 {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:21:16.430048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-45c54d74-6b52-485d-8964-ffbb2c8a7995 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments/de11020e-f5e4-4137-9d15-1d1ce1a89cf0" status: 404 len: 154 microversion: 2.1 time: 0.097270 Jun 18 05:21:16.430048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 338/656] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:21:16 2022] DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0/os-volume_attachments/de11020e-f5e4-4137-9d15-1d1ce1a89cf0 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:21:17.145834 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:17.146460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:17.152888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:17.153334 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:17.154116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:17.154798 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:17.287875 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:17.296046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:17.297628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:17.298726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-7b5daa9c-a6b8-49f8-b38e-85f9de706afa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.157050 Jun 18 05:21:17.299284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 319/657] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:17 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:18.316764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:18.317992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:18.324737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:18.325178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:18.325957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:18.326386 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:18.457517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:18.466063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:18.467491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:18.468581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-eedc3882-2027-4826-bf44-49caf591730c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.155675 Jun 18 05:21:18.469134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 339/658] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:18 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:19.487302 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:19.487833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:19.490421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:19.495181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:19.495628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:19.496405 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:19.496838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:19.607744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "732d7f80-b054-440f-99fd-7833fede72a4"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:19.609678 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:19.617117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:19.618021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=6 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:19.621367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:19.622489 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:19.632161 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:19.632161 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:19.643512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:19.655056 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:19.661955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:19.661955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dc1c8428-b965-4cd2-afb5-9a2ea6cfa0e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.175287 Jun 18 05:21:19.661955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 320/659] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:19 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:19.790756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:19.791253 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:19.797568 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:19.798019 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:19.798779 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:19.799215 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:19.825826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:21:20.155619 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-7c576010-4b74-497f-8caf-9ff3b7246979 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 204 len: 0 microversion: 2.1 time: 0.369139 Jun 18 05:21:20.156316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 321/660] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:21:19 2022] DELETE /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 05:21:20.165612 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:20.166380 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:20.173428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:20.174102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:20.175111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:20.175547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:20.308913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:20.317278 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b6de393d-62de-4e61-ac77-99a93cb62f7e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1552 microversion: 2.1 time: 0.156532 Jun 18 05:21:20.327379 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 322/661] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:20 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:20.449784 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bf282a97-af67-4e69-a70c-0291153e463d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847864 Jun 18 05:21:20.450388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 340/662] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:21:19 2022] POST /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:20.676132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:20.676890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:20.683081 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:20.683525 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:20.684291 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:20.684820 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:20.689161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:20.815321 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:20.823978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:20.826456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:20.826646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a37a1120-5eba-4a78-9932-add858ad7e1e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.154503 Jun 18 05:21:20.827200 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 323/663] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:20 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:20.884768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-1413fc7c-87ab-48b5-ad94-383801bbe7d1 req-28fa08b8-f69d-4002-8ed8-002f0d84bce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "name": "network-vif-plugged", "status": "completed", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:20.893343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-1413fc7c-87ab-48b5-ad94-383801bbe7d1 req-28fa08b8-f69d-4002-8ed8-002f0d84bce8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:20.893811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-1413fc7c-87ab-48b5-ad94-383801bbe7d1 req-28fa08b8-f69d-4002-8ed8-002f0d84bce8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:20.906017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-1413fc7c-87ab-48b5-ad94-383801bbe7d1 req-28fa08b8-f69d-4002-8ed8-002f0d84bce8 service nova] Creating event network-vif-plugged:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:21:20.909846 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-1413fc7c-87ab-48b5-ad94-383801bbe7d1 req-28fa08b8-f69d-4002-8ed8-002f0d84bce8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029056 Jun 18 05:21:20.910410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 341/664] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:21.335107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:21.335711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:21.342300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:21.342746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:21.343527 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:21.343965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:21.470686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:21.478292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9b16fe12-333a-4c2f-baf8-33d04d6515a1 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1552 microversion: 2.1 time: 0.147645 Jun 18 05:21:21.478855 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 324/665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:21 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:21.846144 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:21.846745 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:21.852887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:21.853332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:21.854111 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:21.854546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:21.985865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:21.994203 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:21.995795 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:21.996908 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8174b4f1-5702-4d9f-9ff5-670c4468cb56 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.155221 Jun 18 05:21:21.997487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 342/666] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:21 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:22.495079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:22.495674 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:22.502047 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:22.502489 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:22.503242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:22.503675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:22.635289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:22.642745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3ebe9232-364b-4be1-a768-e13264000e94 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1552 microversion: 2.1 time: 0.151423 Jun 18 05:21:22.643242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 325/667] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:22 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:23.015470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:23.016080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:23.023291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:23.023737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:23.024492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:23.024927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:23.152260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:23.160327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:23.162589 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:23.171691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e15061d1-e0ef-49b1-9f8d-7b3309b25de9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.152106 Jun 18 05:21:23.171691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 343/668] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:23 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:23.671639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:23.671639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:23.671639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:23.671639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:23.672367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:23.672367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:23.806534 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:23.813858 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-90d776e4-fcd2-46e7-90ae-abe4fc576472 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1552 microversion: 2.1 time: 0.157239 Jun 18 05:21:23.814418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 326/669] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:23 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:24.181681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:24.182421 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:24.188772 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:24.189214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:24.189998 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:24.190424 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:24.450236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:24.458379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:24.459932 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:24.461036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-51a311c8-3035-40cd-9f77-a6d2b197d403 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.284158 Jun 18 05:21:24.461852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 344/670] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:24 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:24.774965 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-10a9df2a-3869-498c-bace-d4ade7fb2fe0 req-0e0d837d-4452-4bc9-9324-bac5031b3b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8c3731-ba5b-41dc-ab3b-16d6725300a0", "name": "network-vif-deleted", "tag": "ed5753b8-9359-4e81-8f42-c2dd469ec79e"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:24.788301 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-10a9df2a-3869-498c-bace-d4ade7fb2fe0 req-0e0d837d-4452-4bc9-9324-bac5031b3b11 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:24.788867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-10a9df2a-3869-498c-bace-d4ade7fb2fe0 req-0e0d837d-4452-4bc9-9324-bac5031b3b11 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:24.800604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-10a9df2a-3869-498c-bace-d4ade7fb2fe0 req-0e0d837d-4452-4bc9-9324-bac5031b3b11 service nova] Creating event network-vif-deleted:ed5753b8-9359-4e81-8f42-c2dd469ec79e for instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 on hv-cinder-83699 Jun 18 05:21:24.806397 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-10a9df2a-3869-498c-bace-d4ade7fb2fe0 req-0e0d837d-4452-4bc9-9324-bac5031b3b11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035303 Jun 18 05:21:24.806988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 327/671] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:24.831235 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:24.831868 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:24.837997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:24.841178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:24.841178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:24.841178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:24.911109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:24.919875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9a313f7d-35d5-4cf6-a7a9-78c404d85923 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1510 microversion: 2.1 time: 0.092306 Jun 18 05:21:24.922545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 345/672] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:24 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:25.479268 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:25.479972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:25.486167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:25.486618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:25.487418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:25.487855 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:25.620320 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:25.628172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:25.629706 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:25.630863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9ed55ea7-202e-4b8d-83a4-58de6eb4fb9b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.156350 Jun 18 05:21:25.631423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 328/673] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:25 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:25.936883 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:25.937858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:25.944065 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:25.944511 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:25.945276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:25.945738 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:26.007258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:26.014662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6beffaa1-72aa-4f69-917b-b33b6b09b14e tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1342 microversion: 2.1 time: 0.081729 Jun 18 05:21:26.015231 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 346/674] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:25 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:26.649208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:26.649758 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:26.656424 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:26.656866 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:26.657650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:26.658087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:26.785904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:26.793795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:26.795327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:26.796462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-71c99c1f-e4bf-473a-b3e6-855e91e00daa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.151226 Jun 18 05:21:26.797020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 329/675] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:26 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:27.033945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:27.034595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:27.042719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:27.043168 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:27.043934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:27.044555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:27.107265 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:27.114678 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c1c66539-dced-4ab2-948c-b4fa72662845 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1342 microversion: 2.1 time: 0.086100 Jun 18 05:21:27.115911 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 347/676] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:27 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:27.814939 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:27.815450 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:27.822455 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:27.822897 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:27.823645 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:27.824070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:27.949137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:27.956906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:27.958410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:27.960144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6e33b87c-5b68-4121-a899-5507fb6f7f7c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1406 microversion: 2.20 time: 0.149143 Jun 18 05:21:27.960702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 330/677] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:27 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:28.132409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:28.133022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:28.139519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:28.139971 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:28.140734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:28.141184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:28.204922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:28.212742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3f4e6f12-bb20-427e-88bd-35f8271442de tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1342 microversion: 2.1 time: 0.084707 Jun 18 05:21:28.213308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 348/678] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:28 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:28.978833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:28.979423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:28.985760 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:28.986203 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:28.986955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:28.987383 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:29.125647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:29.132780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:29.134383 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:29.135579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-75fadc67-9799-402f-a613-a70a73d08a84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1597 microversion: 2.20 time: 0.161744 Jun 18 05:21:29.136339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 331/679] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:21:28 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:21:29.154646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:29.155353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:29.162321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:29.163454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:29.164391 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:29.164828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:29.230091 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:29.230702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:29.237812 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:29.238268 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:29.239069 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:29.240185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:29.261221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8ecb37d7-f871-419b-b012-2bbe1278f756 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111191 Jun 18 05:21:29.262452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 349/680] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Jun 18 05:21:29 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:21:29.274920 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:29.275312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:29.275778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lazy-loading 'fault' on Instance uuid bf8c3731-ba5b-41dc-ab3b-16d6725300a0 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:21:29.580541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fba3872764b02bcbcc69299d8768f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a833f00ba294564a66b9eefbc49147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:29.586801 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-786f5424-9812-4396-8b51-c1a6cc5929a8 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 200 len: 1347 microversion: 2.1 time: 0.361335 Jun 18 05:21:29.587984 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 332/681] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:29 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 1347 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:30.553089 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-0e9b30c6-f8f6-4cf8-805b-89369d3236b0 req-bd35897b-a7b2-4486-a168-eca610e13909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:30.561484 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0e9b30c6-f8f6-4cf8-805b-89369d3236b0 req-bd35897b-a7b2-4486-a168-eca610e13909 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:30.561923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0e9b30c6-f8f6-4cf8-805b-89369d3236b0 req-bd35897b-a7b2-4486-a168-eca610e13909 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:30.572601 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-0e9b30c6-f8f6-4cf8-805b-89369d3236b0 req-bd35897b-a7b2-4486-a168-eca610e13909 service nova] Creating event network-changed:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:21:30.577691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-0e9b30c6-f8f6-4cf8-805b-89369d3236b0 req-bd35897b-a7b2-4486-a168-eca610e13909 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029013 Jun 18 05:21:30.578464 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 350/682] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:30.604636 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:30.605248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] [instance: bf8c3731-ba5b-41dc-ab3b-16d6725300a0] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:30.611734 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:30.612181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:30.612939 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:30.613367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:30.626990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] HTTP exception thrown: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 could not be found. Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Request method failure captured: Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 HTTP/1.1 Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWADb7vlF9-qd20obWz_rCtm9FgKjRmVIURXVVBk4FMimxU3lUiGy9mL-ib3PH0Cr36JbYjy1TkkyYiLbEf9k0I9qjlYN01Tvtp8AfoqAhyJK13y16qWCesaJGDYcG9-aLjhjVcrvfptAXFnsVOK4f8bt2yxRzlgQC_B9wxHOGOMPbE Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 3a833f00ba294564a66b9eefbc49147e Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-TestMinimumBasicScenario-1360665084 Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:21:30.628729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a833f00ba294564a66b9eefbc49147e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a833f00ba294564a66b9eefbc49147e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3a833f00ba294564a66b9eefbc49147e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3a833f00ba294564a66b9eefbc49147e"}]}] Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-TestMinimumBasicScenario-1360665084 Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 3a833f00ba294564a66b9eefbc49147e Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1360665084 Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-TestMinimumBasicScenario-1360665084-project Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 113fba3872764b02bcbcc69299d8768f Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-TestMinimumBasicScenario-1360665084-project Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 could not be found. Jun 18 05:21:30.630298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'bf8c3731-ba5b-41dc-ab3b-16d6725300a0'} Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 could not be found. Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:21:30.631051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 could not be found. Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 could not be found. Jun 18 05:21:30.632228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:21:30.633283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Returning 404 to user: Instance bf8c3731-ba5b-41dc-ab3b-16d6725300a0 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:21:30.633283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-66c1a721-ee3c-4ec0-8090-433c3a346463 tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0" status: 404 len: 111 microversion: 2.1 time: 0.030095 Jun 18 05:21:30.633283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 333/683] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:30 2022] GET /compute/v2.1/servers/bf8c3731-ba5b-41dc-ab3b-16d6725300a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:21:30.640905 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-11a1d278-befd-4f42-9a73-c1cfa36ff75a tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] Calling method '.version_select at 0x7f7b00f24a60>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:30.721135 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-11a1d278-befd-4f42-9a73-c1cfa36ff75a tempest-TestMinimumBasicScenario-1360665084 tempest-TestMinimumBasicScenario-1360665084-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-394344384" status: 202 len: 0 microversion: 2.1 time: 0.084469 Jun 18 05:21:30.721972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 351/684] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Jun 18 05:21:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-394344384 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:21:34.553630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:34.555247 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:34.562291 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:34.562738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:34.563711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:34.564151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:34.590507 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'flavor' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:21:34.961117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-73ce2336-ae36-421e-a153-247ef9b0d675 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/action" status: 200 len: 32 microversion: 2.1 time: 0.411340 Jun 18 05:21:34.961774 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 334/685] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:21:34 2022] POST /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:21:34.971699 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:34.972441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:34.979664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:34.980119 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:34.980890 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:34.981328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:35.510533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:35.525133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d646adee-9e6a-4d88-84ec-ba7615556179 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.556714 Jun 18 05:21:35.526141 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 352/686] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:34 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:36.544344 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:36.545044 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:36.547013 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:36.552147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:36.552528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:36.553455 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:36.553941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:36.694189 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:36.703173 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-23cd3976-d374-4874-a0ac-806d0ae76c2d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.163651 Jun 18 05:21:36.703826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 335/687] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:36 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:37.722303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:37.722939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:37.732291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:37.732655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:37.733500 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:37.733941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:38.027783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:38.036069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-17529850-32be-48b5-ad4f-a46deec313b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.318080 Jun 18 05:21:38.036720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 353/688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:37 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:39.055001 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:39.055818 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:39.065049 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:39.065625 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:39.066482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:39.067031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:39.219831 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:39.226636 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e166ba3e-f2b9-4960-82e5-e4c766e6af19 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.176309 Jun 18 05:21:39.227366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 336/689] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:39 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:40.061567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:40.062497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:40.069737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.070236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.071010 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.071701 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.108398 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4e85a94c-5ae5-4dea-bfac-831aadbf80f8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050712 Jun 18 05:21:40.108977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 354/690] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:21:40 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:21:40.188106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:40.189428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:40.203751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.203751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.203751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.203751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.231443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:21:40.245023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:40.245983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:40.253944 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.254662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.256215 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.257728 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.262695 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:40.278245 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:40.402292 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:40.410613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d7f63511-8e5c-4894-8ea2-ce106ce92bf8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.170662 Jun 18 05:21:40.421081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 355/691] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:40 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:40.555777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3d89e512-698d-405c-9ba7-8d1054e2b3bd tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 204 len: 0 microversion: 2.1 time: 0.370170 Jun 18 05:21:40.555777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 337/692] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:21:40 2022] DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:21:40.564597 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:40.565288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:40.572003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.572453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.573224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:40.573826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:40.751422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:40.759196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d690065c-728a-467d-8def-bfe56abe5737 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1672 microversion: 2.1 time: 0.199363 Jun 18 05:21:40.759770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 356/693] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:40 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:41.428963 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:41.429788 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:41.437139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:41.437631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:41.438427 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:41.439035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:41.570583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:41.578825 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ada944f0-7476-4e94-bcd2-aafc612ee1b9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.154516 Jun 18 05:21:41.579401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 338/694] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:41 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:41.938917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:41.941001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:41.945922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:41.946370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:41.947547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:41.947547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:42.083990 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:42.092249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7ee3ab04-3bf1-4125-acde-938db2d92272 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1672 microversion: 2.1 time: 0.318518 Jun 18 05:21:42.092824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 357/695] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:41 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1672 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:42.596079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:42.596592 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:42.603040 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:42.603595 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:42.604346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:42.604781 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:42.753809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:42.762905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-19d8cf64-c587-40e1-9c13-270daa89f891 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.170622 Jun 18 05:21:42.763501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 339/696] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:42 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:43.109934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:43.110582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:43.116931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:43.117511 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:43.118278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:43.118711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:43.342632 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:43.357675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-31083540-73aa-48fa-8a94-cfc0047178d1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1672 microversion: 2.1 time: 0.247270 Jun 18 05:21:43.357675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 358/697] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:43 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:43.780826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:43.782037 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:43.789138 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:43.789848 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:43.790992 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:43.791600 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:43.824662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-f6bf6533-0722-484a-a923-84328084fd82 req-6b42ecfa-d43e-478c-af23-c21f6a8ba38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d96c6-c2da-4ee1-8fd9-554944f65d95", "name": "network-vif-deleted", "tag": "376a2e8d-64a9-45d4-8092-b0e803666ea7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:43.837177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-f6bf6533-0722-484a-a923-84328084fd82 req-6b42ecfa-d43e-478c-af23-c21f6a8ba38b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:43.837909 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-f6bf6533-0722-484a-a923-84328084fd82 req-6b42ecfa-d43e-478c-af23-c21f6a8ba38b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:43.849452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-f6bf6533-0722-484a-a923-84328084fd82 req-6b42ecfa-d43e-478c-af23-c21f6a8ba38b service nova] Creating event network-vif-deleted:376a2e8d-64a9-45d4-8092-b0e803666ea7 for instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 on hv-cinder-83699 Jun 18 05:21:43.856041 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-f6bf6533-0722-484a-a923-84328084fd82 req-6b42ecfa-d43e-478c-af23-c21f6a8ba38b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035268 Jun 18 05:21:43.856837 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 359/698] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:43.958875 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:43.965158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-01a6ccf1-a073-4ee3-97db-1fce793ee177 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.188635 Jun 18 05:21:43.973910 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 340/699] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:43 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:44.381153 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:44.382503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:44.389209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:44.389703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:44.390471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:44.390901 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:44.421861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:44.422302 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:44.422740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lazy-loading 'fault' on Instance uuid 240d96c6-c2da-4ee1-8fd9-554944f65d95 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:21:44.466611 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:44.474524 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3453c152-0124-4d71-8da8-68979fd3187d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 200 len: 1326 microversion: 2.1 time: 0.099101 Jun 18 05:21:44.475696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 360/700] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:44 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:44.982367 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:44.983000 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:44.989648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:44.990090 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:44.991379 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:44.991814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:45.120894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:45.129133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c942bda6-f515-4d3f-834c-e47a692e96e6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.150615 Jun 18 05:21:45.129677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 341/701] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:44 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:45.492949 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:45.493583 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:45.500009 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:45.500449 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:45.501196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:45.501657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:45.515363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] HTTP exception thrown: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Request method failure captured: Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 HTTP/1.1 Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-5q0OQRNSvZuzDq5wNwJhQN4vSWSRPqFYSVXo3ZNkdlXQDN3eDPoi7ud5Ntlqe8eP81bU_O-PlL54ZNkYt_Zt5GVj-8rUBiJIWgH6uSgD3PWXj5P7qe-dj6g-lff1SpM-EWLHBqqvWHlqX1aB-G6YkJZNja4cS4AmrKG_DXe1fkUM Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:21:45.517125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969c470f720c4b2f97ba9f45c5d0d426"}]}] Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: d2c8f964ee6a49cda501ed28a9432c8e Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:21:45.518724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '240d96c6-c2da-4ee1-8fd9-554944f65d95'} Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:21:45.519593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:21:45.520808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:45.522474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Returning 404 to user: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:21:45.522474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fe2850c5-fd30-446a-917f-387b6453aaa1 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 404 len: 111 microversion: 2.1 time: 0.030202 Jun 18 05:21:45.522474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 361/702] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:45 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:21:45.527662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-edc66275-b239-448c-9626-ec4086a6e87b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '.version_select at 0x7f7b01479550>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:45.600100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-edc66275-b239-448c-9626-ec4086a6e87b tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788758118" status: 202 len: 0 microversion: 2.1 time: 0.076193 Jun 18 05:21:45.600667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 342/703] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 05:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788758118 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:21:46.147328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:46.153541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:46.154068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:46.154779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:46.155554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:46.155993 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:46.294193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:46.302343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b2a0c34c-5719-43b2-be03-689e293fec11 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.159350 Jun 18 05:21:46.303532 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 362/704] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:46 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:46.369144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9cd70a76-adba-4260-a7e5-e9e7f16be746 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: .version_select at 0x7f7b014480d0>, body: {"keypair": {"name": "tempest-keypair-1646326506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7GEXrxnTcHus6IBV9lMZvHSUQDKs+rCDfIQkHbT9S5Pn3wvXX0QY4XkuVuSRaKt+jTU+Eom9v1/mecOLVCGl9YG3u7iV6ZpBD/Cd7TjUoYinHlReQOYnrAwzT/IJw7hg=="}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:46.383654 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-9cd70a76-adba-4260-a7e5-e9e7f16be746 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:21:46.387551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-9cd70a76-adba-4260-a7e5-e9e7f16be746 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for user d2c8f964ee6a49cda501ed28a9432c8e and project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'key_pairs'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:21:46.476738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9cd70a76-adba-4260-a7e5-e9e7f16be746 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112874 Jun 18 05:21:46.477276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 343/705] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:21:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:47.320309 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:47.320907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:47.323379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:47.328355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:47.330245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:47.330245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:47.330245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:47.463172 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:47.471842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2e9f9f6a-c620-4216-b128-d05408114c97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.156409 Jun 18 05:21:47.472428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 363/706] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:47 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:48.489332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:48.489973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:48.496596 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:48.497042 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:48.497820 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:48.498248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:48.685749 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:48.694068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e168c492-b42b-4b74-ad0b-8c020923f348 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.208656 Jun 18 05:21:48.694631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 344/707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:48 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:48.813646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-69851130", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22d8eb11-0b66-4ea6-b4d2-3deab0a32f40"}], "security_groups": [{"name": "tempest-securitygroup--797780003"}], "key_name": "tempest-keypair-1646326506", "user_data": "}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:48.914615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] validate_networks() for [('22d8eb11-0b66-4ea6-b4d2-3deab0a32f40', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:21:49.274544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:21:49.274969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:21:49.275464 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:21:49.275897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:21:49.276289 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:21:49.285475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:49.285922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:49.286719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:49.287211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:49.303933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:21:49.307890 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Getting quotas for user d2c8f964ee6a49cda501ed28a9432c8e and project 969c470f720c4b2f97ba9f45c5d0d426. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:21:49.319416 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:21:49.321719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:21:49.446994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-84e65b71-fabe-438e-9983-a90310131f53 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637939 Jun 18 05:21:49.447644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 364/708] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:21:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:21:49.457684 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5805ed9c-b409-4cb6-a985-c612a9f9981c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:49.458295 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5805ed9c-b409-4cb6-a985-c612a9f9981c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:49.512984 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5805ed9c-b409-4cb6-a985-c612a9f9981c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:49.519778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5805ed9c-b409-4cb6-a985-c612a9f9981c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1236 microversion: 2.1 time: 0.065967 Jun 18 05:21:49.521005 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 345/709] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:49 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:49.711043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:49.711659 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:49.717881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:49.718330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:49.719128 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:49.719567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:49.854358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:49.862595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-72aa0506-a7bf-4d2b-9976-43a38490b30e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.155667 Jun 18 05:21:49.863154 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 365/710] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:49 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:50.538140 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:50.538758 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:50.544867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:50.545320 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:50.546111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:50.546547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:50.607438 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:50.615574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8373cbd5-d623-49f8-a272-7a7970444754 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1240 microversion: 2.1 time: 0.081068 Jun 18 05:21:50.621207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 346/711] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:50 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:50.879558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:50.880168 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:50.887457 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:50.887907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:50.888676 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:50.889115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:51.018440 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:51.026724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2cee5141-f5db-40c3-b49f-dfa98c40acc4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.151075 Jun 18 05:21:51.027299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 366/712] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:50 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:51.633112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:51.633760 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:51.640224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:51.640671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:51.641463 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:51.641905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:51.702101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:51.709877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-272168b9-e833-4fcf-aab0-1b98b7196392 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1296 microversion: 2.1 time: 0.080715 Jun 18 05:21:51.710445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 347/713] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:51 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:52.043240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:52.043848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:52.050275 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:52.050726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:52.051481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:52.051912 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:52.179710 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:52.187628 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e15887f7-ac52-41be-a427-ac4da3756df6 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.148263 Jun 18 05:21:52.188198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 367/714] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:52 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:52.729139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:52.729927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:52.737575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:52.738020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:52.739089 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:52.739710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:52.808027 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:52.817638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c3b6d6e8-8756-4758-b1e8-cc025d989f78 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1296 microversion: 2.1 time: 0.094599 Jun 18 05:21:52.818413 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 348/715] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:52 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:53.210623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:53.210623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:53.213765 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:53.214209 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:53.214959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:53.215388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:53.447183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:53.455413 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-50855f2e-30ff-4df1-b428-929a7a1f8fe9 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.253275 Jun 18 05:21:53.456002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 368/716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:53 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:53.835432 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:53.836049 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:53.842582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:53.843034 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:53.843821 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:53.844266 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:53.976409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:53.984304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ebf4238f-90f0-42bc-b577-c1b9e947f07a tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.153398 Jun 18 05:21:53.984894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 349/717] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:53 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:54.474015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:54.475010 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:54.482079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:54.482461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:54.483216 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:54.483646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:54.708515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:54.718034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3115de87-7c9f-45f8-b0af-f80d71a05ad5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1735 microversion: 2.1 time: 0.248509 Jun 18 05:21:54.719206 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 369/718] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:54 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:55.003422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:55.004622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:55.011255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:55.011892 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:55.013011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:55.014089 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:55.095744 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-208a7e6a-0f68-4087-8170-f9ec6d642540 req-28e71b52-266d-42da-af65-fc0f3f40528d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e4e387-f80d-4ab4-b84b-8e300ba1691b", "tag": "de69b734-c483-4ced-a344-3ae592794f9e"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:55.107245 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-208a7e6a-0f68-4087-8170-f9ec6d642540 req-28e71b52-266d-42da-af65-fc0f3f40528d service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:55.108010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-208a7e6a-0f68-4087-8170-f9ec6d642540 req-28e71b52-266d-42da-af65-fc0f3f40528d service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:55.121108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-208a7e6a-0f68-4087-8170-f9ec6d642540 req-28e71b52-266d-42da-af65-fc0f3f40528d service nova] Creating event network-changed:de69b734-c483-4ced-a344-3ae592794f9e for instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b on hv-cinder-83699 Jun 18 05:21:55.129735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-208a7e6a-0f68-4087-8170-f9ec6d642540 req-28e71b52-266d-42da-af65-fc0f3f40528d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193437 Jun 18 05:21:55.131131 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 350/719] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:21:55.259201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:55.266517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4f3e3583-1587-4bf4-9e99-a9ce67a80d35 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.267480 Jun 18 05:21:55.268656 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 370/720] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:54 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:55.736903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:55.737642 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:55.744624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:55.745056 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:55.746046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:55.747339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:55.883074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:55.891292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d796a882-c2e2-460f-ada3-e4bad147c108 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1715 microversion: 2.1 time: 0.158685 Jun 18 05:21:55.891878 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 351/721] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:55 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:55.998573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:55.999124 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:56.005718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.006171 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.007038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.007843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.092636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] HTTP exception thrown: Cannot 'detach_volume' instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 while it is in vm_state rescued Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Request method failure captured: Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments/732d7f80-b054-440f-99fd-7833fede72a4 HTTP/1.1 Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWAJTmp380dwdux2DLXsjuCyStbEwHWeVdk1L8sPhOY-wMgt-oCcWucBg5mR83XOLVrNVoiU2W3UcaCweUZEXENzGwjYzcjFATyv5s4j9ODrKTRUVkasIbCgO3KpsyDUdpVUraDNk4_KY4ro-hkG4XupJZ8dnfrS-1kqTxoStVmDU0g Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:21:56.094267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8820096253064e5abbe50f23bdc3ebac"}]}] Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 216d2b492c55410d9563051142048160 Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:21:56.095913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Cannot 'detach_volume' instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 while it is in vm_state rescued Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'server_id': '5cdfd285-b389-41f4-9ec6-596c6b160f61', 'id': '732d7f80-b054-440f-99fd-7833fede72a4'} Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:21:56.097921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 while it is in vm_state rescued Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 while it is in vm_state rescued Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:21:56.100005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Returning 409 to user: Cannot 'detach_volume' instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 while it is in vm_state rescued {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:21:56.101005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6c5ac923-8db5-46f1-b10a-e96d7890f469 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments/732d7f80-b054-440f-99fd-7833fede72a4" status: 409 len: 152 microversion: 2.1 time: 0.101517 Jun 18 05:21:56.101005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 371/722] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:21:55 2022] DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments/732d7f80-b054-440f-99fd-7833fede72a4 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 05:21:56.107718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:21:56.111696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:56.118492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.118944 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.119711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.120148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.284391 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:56.284997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:56.291181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.291629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.292383 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.292811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.397466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6da3abc2-e2d1-471d-8be5-57c2b62222a4 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "POST /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/action" status: 202 len: 0 microversion: 2.1 time: 0.295005 Jun 18 05:21:56.401120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 352/723] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:21:56 2022] POST /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:21:56.407062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:56.407789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:56.414364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.414816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.415597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:56.416034 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:56.425725 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:56.433234 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-046dcecd-e76f-4c09-b4b7-556221c68e4d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.152710 Jun 18 05:21:56.437514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 372/724] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:56 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:56.550532 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:56.559093 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d8422302-785d-4f60-b406-1f89cedb471c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1723 microversion: 2.1 time: 0.156432 Jun 18 05:21:56.559661 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 353/725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:56 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:57.450268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:57.450884 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:57.457846 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:57.458423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:57.459783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:57.460463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:57.479849 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=100 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:57.576812 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:57.577529 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:57.584185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:57.584746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:57.585546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:57.585981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:57.660133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:57.669667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f57d731e-4422-407b-9227-0e2ddf9bafb5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.222491 Jun 18 05:21:57.674766 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 373/726] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:57 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:57.723395 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:57.732009 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ef590d91-dda2-45dd-9498-b630c71d18fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1723 microversion: 2.1 time: 0.159082 Jun 18 05:21:57.732583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 354/727] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:57 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:58.686605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:58.687211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:58.694451 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:58.694893 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:58.695653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:58.696079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:58.749770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:58.750355 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:58.757991 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:58.758460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:58.759220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:58.759650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:58.827458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:58.835346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-eefb6b2b-cc83-4465-8ac1-095f956bc882 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.152530 Jun 18 05:21:58.840132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 374/728] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:58 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:21:58.908906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:21:58.918032 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d24cac76-39e5-49a1-a1bf-968eb2c193a2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1723 microversion: 2.1 time: 0.172057 Jun 18 05:21:58.918615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 355/729] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:58 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:21:59.853117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:59.853754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:59.855713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:59.856367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=6 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:59.861702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:59.862146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:59.862897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:59.863357 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:59.936471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:21:59.937802 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:21:59.939993 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:59.946377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:59.946825 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:59.947593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:21:59.948027 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:21:59.963693 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:21:59.994369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:00.001824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5fe437ee-804f-4a2b-8cca-7dfceaf4c03e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.153630 Jun 18 05:22:00.002815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 375/730] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:59 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:00.081177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:00.089493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fc327ed4-e2ae-4e71-bf67-be9172f47bed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1723 microversion: 2.1 time: 0.158241 Jun 18 05:22:00.090061 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 356/731] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:21:59 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:00.346579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-b91a0d21-7584-48f2-9844-0442072d97a6 req-effefff3-47bc-477f-b652-b3bfe094b60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e4e387-f80d-4ab4-b84b-8e300ba1691b", "name": "network-vif-plugged", "status": "completed", "tag": "de69b734-c483-4ced-a344-3ae592794f9e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:00.355030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-b91a0d21-7584-48f2-9844-0442072d97a6 req-effefff3-47bc-477f-b652-b3bfe094b60f service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:00.355471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-b91a0d21-7584-48f2-9844-0442072d97a6 req-effefff3-47bc-477f-b652-b3bfe094b60f service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:00.368573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-b91a0d21-7584-48f2-9844-0442072d97a6 req-effefff3-47bc-477f-b652-b3bfe094b60f service nova] Creating event network-vif-plugged:de69b734-c483-4ced-a344-3ae592794f9e for instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b on hv-cinder-83699 Jun 18 05:22:00.373696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-b91a0d21-7584-48f2-9844-0442072d97a6 req-effefff3-47bc-477f-b652-b3bfe094b60f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Jun 18 05:22:00.374283 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 376/732] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:01.020480 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:01.021678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:01.028118 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:01.028566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:01.029593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:01.030045 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:01.107749 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:01.108445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:01.114608 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:01.115239 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:01.116019 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:01.116455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:01.159156 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:01.167378 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-77f53d28-8782-4b07-83ef-71da7ca297dc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1361 microversion: 2.1 time: 0.150997 Jun 18 05:22:01.174989 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 357/733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:01 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:01.250250 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:01.256776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2c074780-7371-4f08-8576-71ee838cad71 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1729 microversion: 2.1 time: 0.153769 Jun 18 05:22:01.257350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 377/734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:01 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:01.273631 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:01.274068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:01.280353 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:01.280799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:01.281600 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:01.282041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:01.365696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b8951211-4335-493d-9324-cc170f02a20f tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095978 Jun 18 05:22:01.366312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 358/735] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:22:01 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:02.184916 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:02.185709 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:02.192463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:02.193564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:02.194453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:02.194887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:02.331405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:02.339009 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-69a8dcea-0d5a-4c2b-9714-89f103e63d28 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1548 microversion: 2.1 time: 0.158089 Jun 18 05:22:02.339577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 378/736] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:02 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:02.356338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:02.356964 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:02.362962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:02.363483 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:02.364314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:02.365541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:02.477447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d14ef5c8-6076-41b6-8344-b3ba7446ef0d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125408 Jun 18 05:22:02.478046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 359/737] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:22:02 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:02.592353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-dfce37a7-2d99-4bf0-80e3-41f120cf43b2 req-60ccb0a9-56bb-438e-b89a-fe2cab7353c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdfd285-b389-41f4-9ec6-596c6b160f61", "tag": "1076f134-7839-4b58-b50b-1f994d3b47a5"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:02.607165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-dfce37a7-2d99-4bf0-80e3-41f120cf43b2 req-60ccb0a9-56bb-438e-b89a-fe2cab7353c9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:02.607614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-dfce37a7-2d99-4bf0-80e3-41f120cf43b2 req-60ccb0a9-56bb-438e-b89a-fe2cab7353c9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:02.622672 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-dfce37a7-2d99-4bf0-80e3-41f120cf43b2 req-60ccb0a9-56bb-438e-b89a-fe2cab7353c9 service nova] Creating event network-changed:1076f134-7839-4b58-b50b-1f994d3b47a5 for instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 on hv-cinder-83699 Jun 18 05:22:02.627795 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-dfce37a7-2d99-4bf0-80e3-41f120cf43b2 req-60ccb0a9-56bb-438e-b89a-fe2cab7353c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Jun 18 05:22:02.628996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 379/738] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:04.057928 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-eac1adb9-e65a-472d-967f-8973c136f569 req-cdb9b9d7-46e8-415a-9d59-a7b4423fdfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e4e387-f80d-4ab4-b84b-8e300ba1691b", "tag": "de69b734-c483-4ced-a344-3ae592794f9e"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:04.066048 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-eac1adb9-e65a-472d-967f-8973c136f569 req-cdb9b9d7-46e8-415a-9d59-a7b4423fdfa7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:04.066481 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-eac1adb9-e65a-472d-967f-8973c136f569 req-cdb9b9d7-46e8-415a-9d59-a7b4423fdfa7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:04.077453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-eac1adb9-e65a-472d-967f-8973c136f569 req-cdb9b9d7-46e8-415a-9d59-a7b4423fdfa7 service nova] Creating event network-changed:de69b734-c483-4ced-a344-3ae592794f9e for instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b on hv-cinder-83699 Jun 18 05:22:04.082354 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-eac1adb9-e65a-472d-967f-8973c136f569 req-cdb9b9d7-46e8-415a-9d59-a7b4423fdfa7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028682 Jun 18 05:22:04.083009 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 360/739] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:04.642492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-0681a795-5602-4fe7-ac88-85d447275c41 req-8c383caa-89f5-47cf-aafa-3c8967b16c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdfd285-b389-41f4-9ec6-596c6b160f61", "tag": "1076f134-7839-4b58-b50b-1f994d3b47a5"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:04.652258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0681a795-5602-4fe7-ac88-85d447275c41 req-8c383caa-89f5-47cf-aafa-3c8967b16c94 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:04.652696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0681a795-5602-4fe7-ac88-85d447275c41 req-8c383caa-89f5-47cf-aafa-3c8967b16c94 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:04.664121 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-0681a795-5602-4fe7-ac88-85d447275c41 req-8c383caa-89f5-47cf-aafa-3c8967b16c94 service nova] Creating event network-changed:1076f134-7839-4b58-b50b-1f994d3b47a5 for instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 on hv-cinder-83699 Jun 18 05:22:04.669188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-0681a795-5602-4fe7-ac88-85d447275c41 req-8c383caa-89f5-47cf-aafa-3c8967b16c94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030612 Jun 18 05:22:04.669810 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 380/740] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:06.608906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:06.609521 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:06.616395 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:06.616839 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:06.617627 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:06.618065 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:06.640759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f98fa574-4dfa-4ab8-9a10-479f488829d4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/ips" status: 200 len: 151 microversion: 2.20 time: 0.132324 Jun 18 05:22:06.641317 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 361/741] 10.222.0.23 () {60 vars in 1288 bytes} [Sat Jun 18 05:22:06 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/ips => generated 151 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:22:09.263066 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:09.263715 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:09.270307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:09.271471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:09.272300 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:09.272729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:09.297235 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lazy-loading 'flavor' on Instance uuid bae5a59b-afc4-4fa7-a230-8590a793bc48 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:09.806793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0104d311-0e7d-45d4-83d1-96c14d410f48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/action" status: 202 len: 0 microversion: 2.20 time: 0.548216 Jun 18 05:22:09.807279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 381/742] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 05:22:09 2022] POST /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:22:09.815404 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:09.816005 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:09.818511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:09.824316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:09.824701 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:09.825484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:09.825918 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:09.958071 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:09.966893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:09.968397 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:09.969606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-391226d0-779b-43fc-b0ea-04344ed68c8e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.158091 Jun 18 05:22:09.970172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 362/743] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:09 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:10.989935 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:10.990618 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:10.997044 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:11.001593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:11.001593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:11.001593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:11.133027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:11.141112 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:11.142647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:11.143791 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d51464ca-c89a-4b3f-98c2-5de2901ed8e9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.158857 Jun 18 05:22:11.144341 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 382/744] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:10 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:12.165038 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:12.165694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:12.172434 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:12.172883 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:12.173651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:12.174080 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:12.304501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:12.312825 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:12.314366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:12.315528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d70e4b40-e578-458b-ad2e-2f1b9cce7650 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.155974 Jun 18 05:22:12.316094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 363/745] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:12 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:13.335138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:13.335731 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:13.342149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:13.342643 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:13.343389 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:13.343814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:13.471943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:13.479981 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:13.481520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:13.482676 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-507dbb5d-3c66-4974-b222-d78e64a7c5df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.152113 Jun 18 05:22:13.483237 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 383/746] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:13 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:14.500236 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:14.501106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:14.508108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:14.508632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:14.509500 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:14.510004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:14.640639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:14.649148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:14.650606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:14.651755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-99a1b06a-7a10-47a3-b772-920804e057da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.155525 Jun 18 05:22:14.652303 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 364/747] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:14 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:15.670946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:15.671465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:15.678987 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:15.679430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:15.680178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:15.680604 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:15.810165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:15.818156 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:15.819667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:15.820825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-38e3888a-a79f-46c7-a548-d6988e19279a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.153774 Jun 18 05:22:15.821419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 384/748] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:15 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:16.481331 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:16.481872 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:16.488278 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:16.488746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:16.489559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:16.489990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:16.512023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lazy-loading 'flavor' on Instance uuid d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:16.716549 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b80c0942-f9bd-49b2-8cdd-a381ae9f4bbd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "POST /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b/action" status: 202 len: 0 microversion: 2.1 time: 0.238882 Jun 18 05:22:16.717160 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 365/749] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:22:16 2022] POST /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:22:16.725476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:16.726088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:16.732387 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:16.732831 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:16.733622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:16.734052 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:16.839556 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:16.840265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:16.847670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:16.848115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:16.848953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:16.849433 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:16.871663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:16.876518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-54b8fbeb-304e-4908-b10a-dbfa70854001 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.154999 Jun 18 05:22:16.877076 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 385/750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:16 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:16.985222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:16.993865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:16.995365 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:16.996726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1c89276f-f8a5-4a42-b612-d6bf8918b780 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.161334 Jun 18 05:22:16.997304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 366/751] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:16 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:17.894802 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:17.895408 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:17.901953 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:17.902398 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:17.903151 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:17.903582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:18.015890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:18.016687 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:18.023447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:18.023890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:18.024657 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:18.025092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:18.035711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:18.043598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0b4c7515-bbcc-4d8c-93cc-b124553de201 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.152648 Jun 18 05:22:18.044159 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 386/752] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:17 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:18.150103 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:18.158082 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:18.159572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:18.160787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-725dca4b-c029-41f3-a9a4-0d7a8f2862ac tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.148919 Jun 18 05:22:18.161348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 367/753] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:18 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:19.060218 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:19.060824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:19.063204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:19.068661 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:19.069140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:19.069924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:19.070363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:19.186361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:19.187150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:19.194960 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:19.195401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:19.196175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:19.196603 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:19.201028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:19.209056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d87ffa74-7468-4131-b757-d68d605cb01d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.152342 Jun 18 05:22:19.209981 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 387/754] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:19 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:19.328368 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:19.336681 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:19.338254 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:19.339419 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b0fd4892-3d55-4b4d-959d-746f7c08aa3f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.156962 Jun 18 05:22:19.339990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 368/755] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:19 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:20.226592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:20.227251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:20.234038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:20.234478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:20.235225 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:20.235650 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:20.357826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:20.358449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:20.364435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:20.365514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:20.365693 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:20.366356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:20.366787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:20.373016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1accf9d0-9477-41e3-a194-0ad58f77645f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.150753 Jun 18 05:22:20.377777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 388/756] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:20 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:20.503351 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:20.511679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:20.513179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:20.514364 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-aff2a397-4c43-4911-b622-5cf7bb003ab0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.160602 Jun 18 05:22:20.514932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 369/757] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:20 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:21.390693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:21.391252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:21.397887 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:21.398332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:21.399095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:21.399526 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:21.533170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:21.533813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:21.534146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:21.540977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:21.541452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:21.541707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ef1e7d89-40db-414f-af7b-a62cf29718b0 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.154910 Jun 18 05:22:21.542242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:21.542357 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 389/758] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:21 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:21.542670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:21.669762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:21.678151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:21.679634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:21.680782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6f954a01-28fb-43df-b2a2-148ab45b1d9d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1743 microversion: 2.20 time: 0.151762 Jun 18 05:22:21.681331 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 370/759] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:21 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:22.558557 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:22.559158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:22.565446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:22.566437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:22.566704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:22.567067 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:22.570681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:22.705867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:22.705867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:22.706474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:22.707402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:22.707853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:22.708668 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:22.709692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:22.711328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5ff8e0d2-eea8-4604-8ec1-4e39cb43f91c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.156615 Jun 18 05:22:22.711902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 390/760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:22 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:22.842509 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:22.850870 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:22.852376 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:22.853581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cda6d4c3-87bd-4617-9d28-bc5567c1fc07 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1743 microversion: 2.20 time: 0.157260 Jun 18 05:22:22.854149 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 371/761] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:22 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:23.729101 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:23.731863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:23.736810 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:23.737258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:23.738106 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:23.738539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:23.871750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:23.872382 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:23.872535 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:23.879123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:23.880858 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:23.880978 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-572118b9-874b-435f-8ed7-277048aed7ea tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.155442 Jun 18 05:22:23.881259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:23.881259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:23.881708 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 391/762] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:23 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:24.025342 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:24.027742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:24.034391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:24.035904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:24.037199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-82d68345-3d67-45dd-beba-0da9586ece84 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.169332 Jun 18 05:22:24.037819 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 372/763] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:23 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:24.501804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-8dde42eb-8a01-402e-94d2-f1dbc748273c req-db764c64-ef53-4db1-8e54-aad5286d15c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "name": "network-vif-plugged", "status": "completed", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:24.511646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-8dde42eb-8a01-402e-94d2-f1dbc748273c req-db764c64-ef53-4db1-8e54-aad5286d15c8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:24.512184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-8dde42eb-8a01-402e-94d2-f1dbc748273c req-db764c64-ef53-4db1-8e54-aad5286d15c8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:24.524478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-8dde42eb-8a01-402e-94d2-f1dbc748273c req-db764c64-ef53-4db1-8e54-aad5286d15c8 service nova] Creating event network-vif-plugged:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:22:24.535358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-8dde42eb-8a01-402e-94d2-f1dbc748273c req-db764c64-ef53-4db1-8e54-aad5286d15c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107233 Jun 18 05:22:24.536478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 392/764] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:24.898509 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:24.899239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:24.906911 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:24.907361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:24.908153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:24.908757 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:25.057417 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:25.063162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:25.064436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:25.074868 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e8ec74de-d21b-4927-ac13-b598cab3bbb6 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.180190 Jun 18 05:22:25.075466 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 373/765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:24 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:25.077112 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:25.077773 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:25.078728 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:25.079306 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:25.231310 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:25.240997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:25.242318 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:25.243490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0c1d7b7e-5aad-4363-b3d1-af2fa8a98c21 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.191044 Jun 18 05:22:25.244633 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 393/766] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:25 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:26.093255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:26.093995 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:26.100079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:26.100524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:26.101303 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:26.101752 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:26.253048 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:26.261141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4e12a251-50b7-4f0f-82eb-cf6fa98310e5 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.172154 Jun 18 05:22:26.262393 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:26.263598 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:26.270487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:26.271281 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:26.273254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:26.273404 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 374/767] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:26 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:26.275017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:26.435263 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:26.445653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:26.447164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:26.448466 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9dfd4e9b-2ab8-4019-a809-027d5b23b2e1 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.190027 Jun 18 05:22:26.461128 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 394/768] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:26 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:27.280673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:27.281456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:27.288415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:27.290113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:27.290113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:27.290332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:27.425856 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:27.433411 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6b2a1731-cb1c-4cdc-aa6f-d7ff7df98344 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.157138 Jun 18 05:22:27.434065 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 375/769] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:27 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:27.468630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:27.469929 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:27.478705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:27.480011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:27.480011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:27.480503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:27.699927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:27.708292 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:27.710426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:27.711813 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c3c78b67-0ad5-41d5-8fc7-7483cf7f1613 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.247434 Jun 18 05:22:27.722945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 395/770] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:27 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:28.450239 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:28.450852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:28.458020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:28.458528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:28.459377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:28.459816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:28.609410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:28.620214 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-61f5eed5-0cf6-4072-a057-4a27acfd79de tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.173723 Jun 18 05:22:28.621172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 376/771] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:28 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:28.730475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:28.731717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:28.738825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:28.739519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:28.741228 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:28.741771 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:28.886307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:28.894586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:28.896604 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:28.899588 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-317366ac-f962-4667-8b21-e86fe72ad691 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.173337 Jun 18 05:22:28.900999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 396/772] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:28 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:29.637979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:29.638861 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:29.647425 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:29.648143 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:29.649026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:29.649551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:29.803060 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:29.811276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2668feea-34c0-4cf1-8284-55b81cbd3517 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.177334 Jun 18 05:22:29.820871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 377/773] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:29 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:29.918941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:29.919540 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:29.926197 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:29.926639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:29.927714 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:29.928472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:30.072733 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:30.081081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:30.082624 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:30.084365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f32323f6-039a-440b-8067-bcc90343dd1a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.168891 Jun 18 05:22:30.084991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 397/774] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:29 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:30.828557 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:30.829166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:30.840003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:30.842865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:30.842865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:30.842865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:31.046764 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:31.059098 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-12bd4437-6cbe-4b38-8217-0332893172b4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.234917 Jun 18 05:22:31.059846 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 378/775] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:30 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:31.102452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:31.103098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:31.110019 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:31.114655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:31.114655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:31.114655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:31.273804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:31.284611 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:31.286465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:31.288158 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c16da287-d19c-47f1-9bff-abd236f184c8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.189951 Jun 18 05:22:31.289020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 398/776] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:31 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:32.076187 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:32.076823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:32.083555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.084086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.087473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.088813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.270251 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:32.278555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ef411386-146b-413b-93b6-1a4f0670e80d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1509 microversion: 2.1 time: 0.206106 Jun 18 05:22:32.280818 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 379/777] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:32 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:32.296769 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:32.298105 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:32.306961 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:32.307555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:32.314392 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.315267 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.316285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.317753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.325189 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.325678 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.326536 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.329517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.643844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-265dcdd7-4eb4-4445-ac80-fd364e75ea0d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "POST /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b/action" status: 202 len: 0 microversion: 2.1 time: 0.351259 Jun 18 05:22:32.646829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 399/778] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 05:22:32 2022] POST /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:22:32.654603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-291ef876-6e1c-4e8e-8dd7-4dde71e23c5d req-0fb0f065-b34a-4b13-ac10-cfdc5728835a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:32.664584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-291ef876-6e1c-4e8e-8dd7-4dde71e23c5d req-0fb0f065-b34a-4b13-ac10-cfdc5728835a service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.665375 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-291ef876-6e1c-4e8e-8dd7-4dde71e23c5d req-0fb0f065-b34a-4b13-ac10-cfdc5728835a service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.674235 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:32.677890 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.compute.server_external_events [req-291ef876-6e1c-4e8e-8dd7-4dde71e23c5d req-0fb0f065-b34a-4b13-ac10-cfdc5728835a service nova] Unable to find a host for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b. Dropping event network-vif-unplugged {{(pid=117991) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 05:22:32.679612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-291ef876-6e1c-4e8e-8dd7-4dde71e23c5d req-0fb0f065-b34a-4b13-ac10-cfdc5728835a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030957 Jun 18 05:22:32.681619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 400/779] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 18 05:22:32.687490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:32.691143 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:32.691261 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:32.695982 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:32.696288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.696846 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.697950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:32.698602 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:32.699655 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-56f03041-3d01-47b1-b708-8d2ee157465f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.394546 Jun 18 05:22:32.700285 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 380/780] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:32 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:32.911097 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:32.921451 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0b107156-dce7-4b61-9ae6-399a0df3c8a8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1517 microversion: 2.1 time: 0.238553 Jun 18 05:22:32.922293 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 401/781] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:32 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1517 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:33.718649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:33.719256 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:33.726216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:33.726667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:33.727423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:33.727853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:33.888684 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:33.903055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:33.904901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:33.906100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ac1d1157-6ae6-460d-be6c-9feeb57bba48 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.191402 Jun 18 05:22:33.911010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 381/782] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:33 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:33.941716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:33.944016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:33.950985 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:33.951433 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:33.952207 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:33.952661 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:34.114964 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:34.122767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4baab287-3f1a-4056-8fba-c6d11ff60e05 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1517 microversion: 2.1 time: 0.186774 Jun 18 05:22:34.124001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 402/783] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:33 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:34.923938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:34.924615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:34.931310 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:34.931758 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:34.932523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:34.932962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:35.064789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:35.072571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:35.074099 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:35.075268 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9cdd5831-6df4-4c11-8ad7-353b37762281 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1738 microversion: 2.20 time: 0.155267 Jun 18 05:22:35.075807 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 382/784] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:34 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:35.140535 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:35.141144 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:35.149063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:35.149491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:35.150258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:35.150726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:35.281409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:35.289224 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d00a435b-8b9e-4894-a108-57023c32e3cc tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1519 microversion: 2.1 time: 0.152616 Jun 18 05:22:35.289860 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 403/785] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:35 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:36.093942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:36.094558 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:36.101758 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:36.102200 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:36.102957 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:36.103390 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:36.232048 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:36.239956 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:36.242107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:36.243311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9b585716-ad08-4be5-9a4e-0961bf3aad57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1720 microversion: 2.20 time: 0.153191 Jun 18 05:22:36.243865 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 383/786] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:36 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:36.306168 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:36.306770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:36.313411 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:36.313861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:36.314690 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:36.315194 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:36.449279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:36.456840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-45818bfa-160c-4514-ba68-1adc1f32a99c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.155133 Jun 18 05:22:36.464238 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 404/787] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:36 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:37.262447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:37.263064 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:37.269731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:37.270182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:37.270946 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:37.271381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:37.401765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:37.409945 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:37.411435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:37.412592 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dfe6f2dd-8ce0-415b-91d5-0418a1a960e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1720 microversion: 2.20 time: 0.154099 Jun 18 05:22:37.413697 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 384/788] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:37 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:37.474255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:37.474859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:37.482245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:37.482686 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:37.483435 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:37.483932 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:37.613331 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:37.621766 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-97ac5ec2-1d0c-4a58-9ad5-6f39401f5a42 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.151285 Jun 18 05:22:37.622328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 405/789] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:37 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:38.431702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:38.432391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:38.440284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:38.440823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:38.441815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:38.442336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:38.485662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-8b9a1493-d566-42a6-b22e-869175d159b7 req-93c9098f-1565-4d99-8c5b-46f454bea4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "name": "network-vif-unplugged", "status": "completed", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:38.495548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-8b9a1493-d566-42a6-b22e-869175d159b7 req-93c9098f-1565-4d99-8c5b-46f454bea4a7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:38.496090 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-8b9a1493-d566-42a6-b22e-869175d159b7 req-93c9098f-1565-4d99-8c5b-46f454bea4a7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:38.508262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-8b9a1493-d566-42a6-b22e-869175d159b7 req-93c9098f-1565-4d99-8c5b-46f454bea4a7 service nova] Creating event network-vif-unplugged:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:22:38.514581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-8b9a1493-d566-42a6-b22e-869175d159b7 req-93c9098f-1565-4d99-8c5b-46f454bea4a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032610 Jun 18 05:22:38.515889 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 406/790] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:22:38.598271 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:38.606684 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:38.608177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:38.609339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-09184bcd-64d1-4f76-a30d-484ba7851b2d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1720 microversion: 2.20 time: 0.181778 Jun 18 05:22:38.609914 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 385/791] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:38 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:38.639353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:38.640046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:38.646312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:38.646759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:38.647559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:38.647992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:38.780312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:38.782673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:38.789106 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-68ce09d2-befc-4f57-8854-c45a1690eb4e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.153875 Jun 18 05:22:38.789702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 407/792] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:38 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:39.628183 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:39.628739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:39.636042 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:39.636492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:39.637259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:39.637736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:39.774420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:39.782644 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:39.784146 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:39.785303 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0b6a06e6-8038-4608-86f2-ae48169baefa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1663 microversion: 2.20 time: 0.161200 Jun 18 05:22:39.785903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 386/793] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:39 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:39.803693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73fd5af7-4658-44ea-b9d3-649a2aa71808"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:39.806466 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:39.806581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:39.807149 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:39.813547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:39.814176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:39.814305 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:39.814663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:39.815089 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:39.815430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:39.815538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:39.815867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:39.958448 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:39.967286 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e62b7578-4ad9-4f03-bc19-b72a87f4b733 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.165063 Jun 18 05:22:39.967726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 387/794] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:39 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:40.508690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:40.509210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:40.515338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.515787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.516675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.517113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.596948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'services' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:40.740879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:40.771554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7b1f1755-1054-4a3e-8dae-a2259a2cb6e2 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.971969 Jun 18 05:22:40.772169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 408/795] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Jun 18 05:22:39 2022] POST /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-volume_attachments => generated 188 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 05:22:40.834682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-38fa09ac-0ed1-4269-9027-39fa33ab9b9b tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments/732d7f80-b054-440f-99fd-7833fede72a4" status: 202 len: 0 microversion: 2.1 time: 0.330493 Jun 18 05:22:40.836233 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 388/796] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:22:40 2022] DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments/732d7f80-b054-440f-99fd-7833fede72a4 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:22:40.846319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:40.847888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:40.855950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.856406 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.857184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.857647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.889789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3472c73d-77c9-4fa8-8060-23a6da28933a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047338 Jun 18 05:22:40.890362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 409/797] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:22:40 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:40.895679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:40.896393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:40.903113 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.903566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.904318 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.905001 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.986720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:40.987289 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:40.994069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.994355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:40.995106 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:40.995541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.129162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:41.137789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d1eba040-626f-48a0-b43a-eacbdaafa850 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.155862 Jun 18 05:22:41.138464 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 410/798] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:40 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:41.454391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f08b043d-cca1-4595-ad26-f600d607fa90 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-volume_attachments/73fd5af7-4658-44ea-b9d3-649a2aa71808" status: 202 len: 0 microversion: 2.20 time: 0.562863 Jun 18 05:22:41.455177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 389/799] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Jun 18 05:22:40 2022] DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-volume_attachments/73fd5af7-4658-44ea-b9d3-649a2aa71808 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 18 05:22:41.511313 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:41.511874 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:41.519269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:41.519269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.519269 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:41.519576 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.748054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a2a6e3dd-51a0-4020-8ec2-5ba60d039cfa tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "POST /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/action" status: 202 len: 0 microversion: 2.20 time: 0.240696 Jun 18 05:22:41.748662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 411/800] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 05:22:41 2022] POST /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:22:41.756660 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:41.758483 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:41.765114 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:41.765597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.766363 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:41.766799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.901349 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:41.902095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:41.903014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:41.909986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:41.911524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:41.912731 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0dea1666-b778-427e-b96e-09726ff5a78a tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1671 microversion: 2.20 time: 0.159962 Jun 18 05:22:41.913849 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 390/801] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:41 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:41.914241 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:41.916746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.916746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:41.916746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:41.946139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8e246ba9-7f61-47e6-8829-fd9b4a34a2ee tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048790 Jun 18 05:22:41.946708 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 412/802] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:22:41 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:22:42.156546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:42.159544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:42.170387 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:42.170844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:42.171622 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:42.172068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:42.305953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:42.313912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-72e58797-34ec-4476-8ccd-6c4947966ee8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.162829 Jun 18 05:22:42.314490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 391/803] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:42 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:42.931514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:42.932126 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:42.938746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:42.939193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:42.939946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:42.940379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:42.958325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:42.961112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:42.962543 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=60 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:42.967540 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:42.967986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:42.968746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:42.969178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:42.999116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d322f762-f119-43df-8908-7242627d6f74 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044846 Jun 18 05:22:42.999673 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 392/804] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:22:42 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 05:22:43.086620 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:43.090102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:43.090739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:43.096517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:43.097057 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:43.097651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:43.098055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:43.098589 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:43.099110 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:43.099408 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d32a771e-9939-49b3-a440-cbb585e8a70d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1671 microversion: 2.20 time: 0.171794 Jun 18 05:22:43.100094 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 413/805] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:42 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:43.125439 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:22:43.331704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:43.332317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:43.339452 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:43.339902 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:43.340665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:43.341154 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:43.437302 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9750bdf0-f69e-4553-b4cb-41d1da61b594 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 204 len: 0 microversion: 2.1 time: 0.351565 Jun 18 05:22:43.437954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 393/806] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:22:43 2022] DELETE /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 05:22:43.446555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:43.447492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:43.453425 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:43.458128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:43.458128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:43.458128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:43.473521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:43.481492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ecefdf26-ed33-47a4-8cbf-38a193d1b8bd tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.153597 Jun 18 05:22:43.482355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 414/807] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:43 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:43.588908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:43.596696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3968dd23-88cb-4f5c-b1ab-d0a33a5de5fa tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1689 microversion: 2.1 time: 0.154606 Jun 18 05:22:43.597277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 394/808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:43 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:44.118195 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:44.118819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:44.125165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:44.125652 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:44.126394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:44.126814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:44.254548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:44.262477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:44.263966 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:44.265101 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bc808dfd-76c9-4764-9771-fb1e7e11bdf3 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.151577 Jun 18 05:22:44.265675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 415/809] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:44 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:44.499068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:44.499667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:44.506177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:44.506618 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:44.507522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:44.507951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:44.613539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:44.614140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:44.620282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:44.620722 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:44.621501 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:44.621928 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:44.641453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:44.649498 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b4ea5ce3-d7df-4782-b8ed-1a2814e5acd3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.154507 Jun 18 05:22:44.650006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 395/810] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:44 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:44.751114 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:44.759093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fe59772b-2cfe-4878-90b8-8500d4fa5028 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1689 microversion: 2.1 time: 0.149321 Jun 18 05:22:44.759670 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 416/811] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:44 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:45.283810 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:45.284420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:45.290649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:45.291102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:45.291862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:45.292301 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:45.421850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:45.429877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:45.431380 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:45.432544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-00f53d6c-7b44-4953-a882-5e78338ab5de tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.152908 Jun 18 05:22:45.433109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 396/812] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:45 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:45.665946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:45.666477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:45.672917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:45.673365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:45.674157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:45.674588 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:45.776491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:45.777246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:45.783931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:45.784372 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:45.785123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:45.785609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:45.803731 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:45.811365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-39749e36-8c58-429c-9e39-f16f9fa0e977 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.149457 Jun 18 05:22:45.812123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 417/813] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:45 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:45.917430 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:45.924840 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-af591d44-9c0b-4415-906c-d179305707b8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1689 microversion: 2.1 time: 0.152715 Jun 18 05:22:45.925429 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 397/814] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:45 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:46.451458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:46.452062 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:46.458014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:46.458560 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:46.459276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:46.459702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:46.586398 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:46.594271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:46.595762 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:46.596907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-941f7990-eea3-40ae-aee0-ba2ca6cc4ca7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.149614 Jun 18 05:22:46.597476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 418/815] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:46 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:46.828850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:46.829481 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:46.836555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:46.836999 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:46.837779 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:46.838210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:46.941976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:46.942561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:46.950127 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:46.950665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:46.951439 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:46.951872 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:46.971667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:46.980079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-67a62a1e-4894-498c-bc3c-e918f247c12a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.155044 Jun 18 05:22:46.980647 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 398/816] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:46 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:47.079786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:47.088189 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b97820ee-fe67-47d0-9623-4aaefccb3a73 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1689 microversion: 2.1 time: 0.150122 Jun 18 05:22:47.088753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 419/817] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:46 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:47.411352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:47.411841 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:47.418688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:47.419132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:47.419884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:47.420312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:47.442772 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-79f3428b-fe33-46e0-b330-cd5f58dde48f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/ips" status: 200 len: 147 microversion: 2.1 time: 0.035315 Jun 18 05:22:47.443325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 399/818] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:22:47 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:47.614476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:47.615113 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:47.621924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:47.622369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:47.623134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:47.623570 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:47.998408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:47.999112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:48.006433 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:48.007210 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:48.008016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:48.008447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:48.152529 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:48.160547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d02ffa29-3cca-4f84-b147-13abcc152062 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.166229 Jun 18 05:22:48.161116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 400/819] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:47 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:48.166546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:48.167141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:48.173980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:48.174425 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:48.175222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:48.175827 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:48.194490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:48.242788 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:48.245461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:48.252899 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:48.256950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:48.256950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a903a6ba-6869-45ad-8c9c-977503e83e0e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.645423 Jun 18 05:22:48.256950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 420/820] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:47 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:48.313476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:48.321752 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0d504e71-2c95-426a-814f-958bd2decb1e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1689 microversion: 2.1 time: 0.159323 Jun 18 05:22:48.322331 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 401/821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:48 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:49.027789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c4342f2-cacf-4b1f-bf1c-a1970278bf27"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:49.028928 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:49.036006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.037776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.037776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.037776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.178354 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:49.179095 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:49.188014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.188527 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.191498 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.191498 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.356071 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:49.364335 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9168ceb0-00d9-47c3-b421-c5a86bfb0031 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.190030 Jun 18 05:22:49.364948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 402/822] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:49 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:49.370919 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:49.371525 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:49.384887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.385339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.427482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.428667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.714730 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:49.730723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:49.733816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:49.738178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-92b3bf87-1ded-43b8-ac1a-ee39a5791cab tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.369863 Jun 18 05:22:49.738178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 403/823] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:49 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:49.748950 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-34975821-644d-4daf-93cf-c2e8b5b52686 req-b75a71c6-6fa1-4871-a227-3d09033d2c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdfd285-b389-41f4-9ec6-596c6b160f61", "name": "network-vif-deleted", "tag": "1076f134-7839-4b58-b50b-1f994d3b47a5"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:49.761243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-34975821-644d-4daf-93cf-c2e8b5b52686 req-b75a71c6-6fa1-4871-a227-3d09033d2c2e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.762478 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-34975821-644d-4daf-93cf-c2e8b5b52686 req-b75a71c6-6fa1-4871-a227-3d09033d2c2e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.781593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-34975821-644d-4daf-93cf-c2e8b5b52686 req-b75a71c6-6fa1-4871-a227-3d09033d2c2e service nova] Creating event network-vif-deleted:1076f134-7839-4b58-b50b-1f994d3b47a5 for instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 on hv-cinder-83699 Jun 18 05:22:49.789593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-34975821-644d-4daf-93cf-c2e8b5b52686 req-b75a71c6-6fa1-4871-a227-3d09033d2c2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045071 Jun 18 05:22:49.790767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 404/824] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:49.808431 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:49.809572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:49.817347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.818018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.819382 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.820773 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.860430 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:49.861060 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:49.861768 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:49.936512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0b17af4c-d879-462d-9649-caab889c8e51 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913206 Jun 18 05:22:49.937038 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:49.942049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 421/825] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:22:49 2022] POST /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:49.964759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b64f5294-0ad9-4fe0-b8d3-981963906422 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.170569 Jun 18 05:22:49.964759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 405/826] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:49 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:50.388186 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:50.389141 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:50.396149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=74 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:50.398754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:50.399388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:50.400336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:50.400942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:50.580615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:50.589096 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-442ca1e1-9aee-491a-8131-0e0e95e0c219 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.211081 Jun 18 05:22:50.589825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 422/827] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:50 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:50.755933 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:50.756652 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:50.763890 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:50.764564 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:50.765609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:50.766204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:50.916633 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:50.951300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:50.955101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:50.958606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-39f895a6-707c-4901-8163-c899bf4a7a06 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.204638 Jun 18 05:22:50.958606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 406/828] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:50 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:50.982768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:50.983474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:50.992932 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:50.993441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:50.994200 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:50.994634 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:51.055614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:51.056073 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:51.056582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:51.102014 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:51.109513 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e4861b1a-4226-4413-9668-477edc98fdd2 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.130578 Jun 18 05:22:51.110079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 423/829] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:50 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:51.607646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:51.608179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:51.614446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:51.614970 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:51.615741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:51.616301 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:51.763086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:51.771171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2b0954ce-a9c9-4b92-aa55-503ef4e83783 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.167443 Jun 18 05:22:51.771748 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 407/830] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:51 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:51.974624 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:51.975780 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:51.983090 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:51.983714 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:51.984508 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:51.984940 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.127393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:52.128014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:52.135842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:52.136372 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.137474 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:52.138068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.171091 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:52.180530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:52.182156 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:52.184005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-861bd2d3-2f3d-49ea-9d0f-dc77ce9e962e tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.213276 Jun 18 05:22:52.184644 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 424/831] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:51 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:52.191836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:52.192289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.192838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:52.233308 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:52.241218 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-01a1b3ee-a0bb-4916-9886-579e5d1b11bc tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.117802 Jun 18 05:22:52.242158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 408/832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:52 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:52.606343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-0a2230e3-781c-43ee-acee-7d5ab997aeaf req-e70996e4-6821-4a1d-94c0-9c797c63c826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "name": "network-vif-plugged", "status": "completed", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:22:52.619298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0a2230e3-781c-43ee-acee-7d5ab997aeaf req-e70996e4-6821-4a1d-94c0-9c797c63c826 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:52.619298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0a2230e3-781c-43ee-acee-7d5ab997aeaf req-e70996e4-6821-4a1d-94c0-9c797c63c826 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.629797 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-0a2230e3-781c-43ee-acee-7d5ab997aeaf req-e70996e4-6821-4a1d-94c0-9c797c63c826 service nova] Creating event network-vif-plugged:2e6ea935-169b-426c-bf26-11d644b1d476 for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b on hv-cinder-83699 Jun 18 05:22:52.635589 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-0a2230e3-781c-43ee-acee-7d5ab997aeaf req-e70996e4-6821-4a1d-94c0-9c797c63c826 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Jun 18 05:22:52.637928 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 425/833] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:22:52.790012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:52.790676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:52.797689 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:52.798402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.799340 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:52.799935 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:52.955617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:52.965063 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bdaece72-4920-4454-b7cc-b371a5241b0c tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.179760 Jun 18 05:22:52.965882 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 409/834] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:52 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:53.205896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:53.207181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:53.214730 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.215095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:53.216182 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.216633 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:53.258557 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:53.259172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:53.265152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.265648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:53.266423 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.266863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:53.298160 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.298615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:53.299067 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:53.377602 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:53.378081 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:53.384303 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-298a20a4-a080-44ec-a65f-c5c187683923 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.129862 Jun 18 05:22:53.384718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 410/835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:53 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:22:53.387942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:53.389924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:53.391673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b270f715-1a69-4feb-ae85-0d45362349f4 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.192441 Jun 18 05:22:53.403591 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 426/836] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:53 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:53.982676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:53.983278 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:53.989940 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.990386 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:53.991897 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:53.992663 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:54.133248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:54.140718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-86e9a0bc-4e9f-4683-9b71-66980083ddf3 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.161949 Jun 18 05:22:54.141292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 411/837] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:53 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:54.401480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:54.402307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:54.409122 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:54.409671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:54.410436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:54.410866 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:54.414166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:54.414767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:54.420591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:54.421036 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:54.421823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:54.422265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:54.443411 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:54.443854 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:54.444328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:54.516545 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:54.524829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c7928506-3877-4ba3-9819-08aabe8f5b00 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.127660 Jun 18 05:22:54.525992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 427/838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:54 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:54.594738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:54.602878 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:54.604377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:54.605587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5d477c00-d93d-49a4-8076-36c0ef4ef7df tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.195858 Jun 18 05:22:54.606150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 412/839] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:54 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:55.158491 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:55.159035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:55.170968 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.171603 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.172778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.173056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.331651 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:55.339890 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ccbf179c-8bc2-49c5-bc7d-af8234becffe tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.185897 Jun 18 05:22:55.340675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 428/840] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:55 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:55.542694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:55.543314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:55.549986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.550428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.551259 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.551706 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.589026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.589320 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.589733 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:55.624210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:55.624882 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:55.635738 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.636253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.637028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:55.638615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:55.640477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:55.650888 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fdb6a419-2ccb-4faf-8ad2-86a476bd2e60 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.112464 Jun 18 05:22:55.651866 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 413/841] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:55 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:55.800262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:55.809397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:55.810895 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:55.812056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1a4fd2e6-ca3e-473f-802d-981a31806bd8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.191726 Jun 18 05:22:55.812606 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 429/842] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:55 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:22:56.364916 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:56.365582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:56.373168 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.373664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.374450 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.374921 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.522025 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:56.530893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ff358952-f30d-44cc-9a90-6239e715fdf4 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.171050 Jun 18 05:22:56.531664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 414/843] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:56 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:56.669429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:56.671108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:56.679788 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.680620 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.681801 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.682607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.728521 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.728970 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.729471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:56.771946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:56.780343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3942da13-1f84-4f06-a120-055a654f8f5e tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.115115 Jun 18 05:22:56.780913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 430/844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:56 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:56.831140 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:56.832002 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:56.839998 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.840442 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.841240 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:56.841713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:56.987980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:56.996705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:56.998235 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:56.999409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cc04cb6f-b600-4ca1-927f-f60ad1355b3d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.172855 Jun 18 05:22:56.999966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 415/845] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:56 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:57.547876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:57.548485 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:57.555132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:57.555573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:57.556333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:57.556760 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:57.708005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:57.716933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-142900ed-0b73-4c66-933d-0ccf301233ed tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.172768 Jun 18 05:22:57.721572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 431/846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:57 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:57.797292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:57.797864 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:57.804599 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:57.805558 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:57.805863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:57.806304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:57.852356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:57.853262 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:57.853262 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:57.903637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:57.911745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f62ca2eb-fab7-4962-bd31-24f0e81b95ed tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.118336 Jun 18 05:22:57.912335 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 416/847] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:57 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:58.018859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:58.019464 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:58.025686 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.026136 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.026917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.027352 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.172433 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:58.182346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:58.185571 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:58.186270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1cfd1a35-f325-4d00-b694-02e6051c4e67 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.171069 Jun 18 05:22:58.187231 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 432/848] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:58 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:58.734280 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:58.735130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:58.743052 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.743495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.744317 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.744751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.749559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=100 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:22:58.878880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:58.886777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-df31d395-4e2e-4440-bc70-c50b85ba2b8f tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.156423 Jun 18 05:22:58.887351 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 417/849] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:58 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:58.929830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:58.930445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:58.936815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.937263 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.938083 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.938544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.968911 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:58.969348 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:58.969825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:22:59.012424 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:59.019692 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cb956865-ff45-4963-b784-7ce9d0e9067c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.093925 Jun 18 05:22:59.020254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 433/850] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:58 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:22:59.207993 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:59.208590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:59.215202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:59.215749 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:59.216738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:59.280559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:59.345893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:59.355799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:59.357217 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:22:59.358429 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b3ad9842-afee-43ab-a90c-9b0ef0c51914 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.154340 Jun 18 05:22:59.358983 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 418/851] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:22:59 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:22:59.904165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:22:59.904948 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:22:59.911068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:59.911509 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:22:59.912311 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:22:59.912743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:00.036422 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:00.037031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:00.047783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:00.048272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:00.048272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:00.048272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:00.048272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:00.051007 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-05110507-6149-49df-a191-73d46bfb6420 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.150765 Jun 18 05:23:00.051573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 434/852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:22:59 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:00.081059 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:00.081763 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:00.082431 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5cdfd285-b389-41f4-9ec6-596c6b160f61 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:00.128738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:00.136453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-12f6e31d-03bb-4c11-ba18-57ea665ceac8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 200 len: 1335 microversion: 2.1 time: 0.103950 Jun 18 05:23:00.139434 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 419/853] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:00 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:00.376148 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:00.376746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:00.382895 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:00.383345 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:00.384145 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:00.384580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:00.402223 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:00.514726 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:00.523437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:00.524783 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:00.525972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fc637569-1152-4aa5-a464-db742c726a25 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.153769 Jun 18 05:23:00.526528 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 435/854] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:00 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:01.069999 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:01.070574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:01.076970 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:01.077437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:01.078186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:01.078617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:01.154746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:01.155455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5cdfd285-b389-41f4-9ec6-596c6b160f61] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:01.163462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:01.164145 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:01.165015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:01.165548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:01.181054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] HTTP exception thrown: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 could not be found. Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Request method failure captured: Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 HTTP/1.1 Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWAJTmp380dwdux2DLXsjuCyStbEwHWeVdk1L8sPhOY-wMgt-oCcWucBg5mR83XOLVrNVoiU2W3UcaCweUZEXENzGwjYzcjFATyv5s4j9ODrKTRUVkasIbCgO3KpsyDUdpVUraDNk4_KY4ro-hkG4XupJZ8dnfrS-1kqTxoStVmDU0g Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:01.182841 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8820096253064e5abbe50f23bdc3ebac"}]}] Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 216d2b492c55410d9563051142048160 Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 could not be found. Jun 18 05:23:01.184497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '5cdfd285-b389-41f4-9ec6-596c6b160f61'} Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 could not be found. Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:01.185443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 could not be found. Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 could not be found. Jun 18 05:23:01.186959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:01.188483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Returning 404 to user: Instance 5cdfd285-b389-41f4-9ec6-596c6b160f61 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:01.188483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-52c8becd-ce0d-4dd9-8a38-9809b0959cb5 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61" status: 404 len: 111 microversion: 2.1 time: 0.033744 Jun 18 05:23:01.188483 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 436/855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:01 2022] GET /compute/v2.1/servers/5cdfd285-b389-41f4-9ec6-596c6b160f61 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:01.192808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-25215711-93e4-43f4-a264-7c1372d9ac91 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '.version_select at 0x7f7b05f33940>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:01.217073 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:01.224567 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a35525a6-4b7f-4a93-a172-08c7d473c1ec tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1575 microversion: 2.1 time: 0.159278 Jun 18 05:23:01.225134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 420/856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:01 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:01.261790 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-25215711-93e4-43f4-a264-7c1372d9ac91 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-855682562" status: 202 len: 0 microversion: 2.1 time: 0.072523 Jun 18 05:23:01.262364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 437/857] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 05:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-855682562 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:23:01.545071 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:01.545778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:01.551867 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:01.552503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:01.553270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:01.554454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:01.690588 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:01.698740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:01.700237 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:01.701442 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-672f3681-1483-45cf-9ae5-c97fa2320db8 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.160481 Jun 18 05:23:01.713117 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 421/858] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:01 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:02.241880 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:02.242619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:02.249724 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:02.253031 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:02.253031 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:02.253031 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:02.400445 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:02.408170 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-72f305ca-dbba-41f8-b8aa-85fac35be80e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1562 microversion: 2.1 time: 0.170284 Jun 18 05:23:02.408729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 438/859] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:02 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:02.720108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:02.720710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:02.728238 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:02.728682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:02.729454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:02.729884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:02.875998 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:02.885074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:02.887796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:02.887796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4f11d092-845a-4159-9636-64c18bba8de7 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.171746 Jun 18 05:23:02.888277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 422/860] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:02 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:03.906764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:03.907394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:03.914490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:03.914931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:03.915681 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:03.916110 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:04.058027 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:04.150647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:04.150647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:04.150647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0562f38d-f734-4b9c-8c59-7aa6bd81ea51 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.168889 Jun 18 05:23:04.151022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 439/861] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:03 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:04.639076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-483a451f-5454-4906-8e20-b890f69701e8 req-c0cd6d43-c615-44ed-9007-5c5db23e1a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "name": "network-vif-plugged", "status": "completed", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:04.639573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:04.639573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:04.645973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:04.646512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:04.646843 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-483a451f-5454-4906-8e20-b890f69701e8 req-c0cd6d43-c615-44ed-9007-5c5db23e1a36 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:04.647371 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-483a451f-5454-4906-8e20-b890f69701e8 req-c0cd6d43-c615-44ed-9007-5c5db23e1a36 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:04.647584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:04.648094 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:04.659074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-483a451f-5454-4906-8e20-b890f69701e8 req-c0cd6d43-c615-44ed-9007-5c5db23e1a36 service nova] Creating event network-vif-plugged:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:23:04.664558 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-483a451f-5454-4906-8e20-b890f69701e8 req-c0cd6d43-c615-44ed-9007-5c5db23e1a36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029952 Jun 18 05:23:04.665153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 423/862] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:04.674421 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:23:04.989087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b1f35ea6-4f3b-480e-93b4-5bfd3cb9317a tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 204 len: 0 microversion: 2.1 time: 0.353896 Jun 18 05:23:04.989931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 440/863] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:23:04 2022] DELETE /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 05:23:04.998468 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:04.999189 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:05.005295 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:05.005786 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:05.006640 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:05.007159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:05.092384 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:05.093079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:05.099138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:05.102455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:05.102455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:05.102455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:05.141496 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:05.149745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c8376942-4ae4-48ae-9621-ae4ae0f0ac99 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1508 microversion: 2.1 time: 0.155382 Jun 18 05:23:05.150331 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 424/864] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:04 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:05.232567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:05.240502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:05.242202 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:05.243356 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f349e124-1f90-4f1b-ab17-018fb8ea02cd tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.155311 Jun 18 05:23:05.243916 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 441/865] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:05 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:23:06.167499 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:06.168108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:06.174577 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:06.175023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:06.175830 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:06.176265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:06.260707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:06.261313 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:06.267846 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:06.268296 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:06.269062 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:06.269528 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:06.310980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:06.318910 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a310697e-c16e-4691-894f-68ae9643be84 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1508 microversion: 2.1 time: 0.155911 Jun 18 05:23:06.319609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 425/866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:06 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:06.402312 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:06.410393 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:06.415774 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:06.415774 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bbf46e2d-7826-4bfe-a241-b7127faec29d tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.156126 Jun 18 05:23:06.415774 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 442/867] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:06 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:23:07.336197 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:07.336809 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:07.343510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:07.343953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:07.344713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:07.345149 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:07.434134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:07.434134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:07.440538 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:07.440977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:07.441756 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:07.442186 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:07.486167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:07.495667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e2e4944e-087c-4493-92c6-a2f56279b9ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1508 microversion: 2.1 time: 0.163462 Jun 18 05:23:07.504943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 426/868] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:07 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:07.658077 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:07.666671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:07.668165 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:07.669315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-76225cb5-8fe8-49e3-9858-bd4dcb627f93 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.241009 Jun 18 05:23:07.669903 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 443/869] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:07 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 05:23:08.512672 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:08.513284 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:08.519743 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:08.521949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:08.521949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:08.521949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:08.598344 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:08.606275 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d2071328-1a90-41de-9fed-50d252cf8bcf tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1466 microversion: 2.1 time: 0.097449 Jun 18 05:23:08.606931 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 427/870] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:08 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1466 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:08.633070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-76040bb2-d0b7-4585-828b-c236a4698e01 req-a1b2c1ac-7ec3-465f-a61a-f457136ecd76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b8a5eb5-afb5-4209-9aa5-b38844bf07f2", "name": "network-vif-deleted", "tag": "8e5d7c91-931e-49de-80d5-fe09b507ebe5"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:08.641958 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-76040bb2-d0b7-4585-828b-c236a4698e01 req-a1b2c1ac-7ec3-465f-a61a-f457136ecd76 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:08.642561 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-76040bb2-d0b7-4585-828b-c236a4698e01 req-a1b2c1ac-7ec3-465f-a61a-f457136ecd76 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:08.654115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-76040bb2-d0b7-4585-828b-c236a4698e01 req-a1b2c1ac-7ec3-465f-a61a-f457136ecd76 service nova] Creating event network-vif-deleted:8e5d7c91-931e-49de-80d5-fe09b507ebe5 for instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 on hv-cinder-83699 Jun 18 05:23:08.659235 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-76040bb2-d0b7-4585-828b-c236a4698e01 req-a1b2c1ac-7ec3-465f-a61a-f457136ecd76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031050 Jun 18 05:23:08.660005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 444/871] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:08.688328 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:08.689020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:08.697795 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:08.698248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:08.699023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:08.699705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:08.833693 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:08.841978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:08.843630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:08.844801 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-976e77b3-5721-4f6f-b51a-48a557fffb0f tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.160665 Jun 18 05:23:08.845360 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 428/872] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:08 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:09.199309 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:09.200476 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:09.207116 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.207617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.208370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.208830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.237876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6e72e6be-dc89-4e55-9f76-ca6a812fe9b8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Jun 18 05:23:09.238419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 445/873] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:23:09 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:23:09.249372 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:09.249884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:09.255950 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.256393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.257223 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.257680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.286246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6d7b2324-1ad1-4f14-ab7c-717acf3cfb8c tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/2c4342f2-cacf-4b1f-bf1c-a1970278bf27" status: 200 len: 194 microversion: 2.1 time: 0.040791 Jun 18 05:23:09.287096 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 429/874] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Jun 18 05:23:09 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/2c4342f2-cacf-4b1f-bf1c-a1970278bf27 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:09.623956 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:09.624560 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:09.630584 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.631021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.632509 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.632941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.666419 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.667050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.667332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:09.708321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:09.715794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c73a5f98-e9eb-470c-9168-04b1e95a4f97 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 200 len: 1312 microversion: 2.1 time: 0.095803 Jun 18 05:23:09.716595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 446/875] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:09 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:09.865604 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:09.867017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:09.875123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.875853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:09.876794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:09.877401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.016070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:10.031277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:10.033586 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:10.035435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6dc7c317-3c18-48fc-8f12-fafbd346f411 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1729 microversion: 2.20 time: 0.174878 Jun 18 05:23:10.035998 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 430/876] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:09 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:10.746987 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:10.747599 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:10.754809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:10.754809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.755427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:10.755863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.769833 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] HTTP exception thrown: Instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 could not be found. Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Request method failure captured: Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 HTTP/1.1 Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWAJTmp380dwdux2DLXsjuCyStbEwHWeVdk1L8sPhOY-wMgt-oCcWucBg5mR83XOLVrNVoiU2W3UcaCweUZEXENzGwjYzcjFATyv5s4j9ODrKTRUVkasIbCgO3KpsyDUdpVUraDNk4_KY4ro-hkG4XupJZ8dnfrS-1kqTxoStVmDU0g Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:10.771454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8820096253064e5abbe50f23bdc3ebac"}]}] Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 216d2b492c55410d9563051142048160 Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 could not be found. Jun 18 05:23:10.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '5b8a5eb5-afb5-4209-9aa5-b38844bf07f2'} Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 could not be found. Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:10.777933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 could not be found. Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 could not be found. Jun 18 05:23:10.779104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:10.780428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Returning 404 to user: Instance 5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:10.780428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e92401bb-2ea1-4c42-8f62-018dd5b9475d tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2" status: 404 len: 111 microversion: 2.1 time: 0.029759 Jun 18 05:23:10.780428 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 447/877] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:10 2022] GET /compute/v2.1/servers/5b8a5eb5-afb5-4209-9aa5-b38844bf07f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:10.781677 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:10.782176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:10.788382 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:10.788848 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.789637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:10.790075 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.816568 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:23:10.952463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e66e4ed0-157d-4a6e-acbe-0e768a10bc67"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:10.953704 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:10.959883 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:10.960330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.961089 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:10.961554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:10.999335 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:11.070308 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0b3616bc-628a-41ed-9e79-9d8d805d7d09 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "DELETE /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 204 len: 0 microversion: 2.1 time: 0.291279 Jun 18 05:23:11.070891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 431/878] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:23:10 2022] DELETE /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:23:11.076104 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:11.076830 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:11.083451 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:11.083946 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:11.085225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:11.085692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:11.104836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:11.219248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:11.227750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:11.229245 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:11.230455 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-39e12620-10f5-4fdd-a0d5-972818d45e68 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1716 microversion: 2.20 time: 0.158486 Jun 18 05:23:11.231008 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 432/879] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:11 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:11.235302 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:11.235904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:11.242209 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:11.242656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:11.243418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:11.243853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:11.375538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:11.383306 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ddddadec-498d-492e-a2ee-b8db958b46e8 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.151309 Jun 18 05:23:11.383886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 433/880] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:11 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:12.153115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:12.153814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:12.160246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:12.160696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:12.161469 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:12.161900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:12.187553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:23:12.440296 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c59956ab-05e2-48f9-9177-7e0482ce8b36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 204 len: 0 microversion: 2.1 time: 0.290730 Jun 18 05:23:12.440877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 434/881] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:23:12 2022] DELETE /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:23:12.446083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:12.446807 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:12.452591 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:12.453038 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:12.453816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:12.454252 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:12.584201 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:12.592324 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9374c3f7-877b-47c7-a203-29e529157a04 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.150288 Jun 18 05:23:12.592932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 435/882] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:12 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:12.597325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:12.602333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:12.604377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:12.604852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:12.605643 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:12.606086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:12.737158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:12.744839 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8cd46792-4fa6-4396-b526-acf921127e2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1578 microversion: 2.1 time: 0.150911 Jun 18 05:23:12.745440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 436/883] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:12 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:13.609808 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:13.610449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:13.617139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:13.617607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:13.618359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:13.618789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:13.752316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:13.760406 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a662b0b1-6d64-4855-89ac-28cd7da64388 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.154504 Jun 18 05:23:13.760970 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 437/884] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:13 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:13.765298 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:13.765930 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:13.771585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:13.772191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:13.773029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:13.773496 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:13.900143 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:13.907751 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-10e785dc-eff4-4b37-b84d-b410fdeeb8d9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1578 microversion: 2.1 time: 0.145819 Jun 18 05:23:13.908304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 438/885] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:13 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1578 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:14.518083 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-be377f26-0cc7-4248-ab1f-1402a0bc2a63 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "POST /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.569405 Jun 18 05:23:14.518712 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 448/886] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:23:10 2022] POST /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments => generated 194 bytes in 3571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:23:14.776606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:14.777139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:14.783959 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:14.784408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:14.785172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:14.785643 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:14.916207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:14.923588 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-24756a11-295d-4e96-b260-ac31341a20ba tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.151101 Jun 18 05:23:14.924151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 439/887] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:14 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:14.925630 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:14.926317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:14.932937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:14.933405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:14.934157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:14.934586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:15.064771 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:15.072820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0cff404b-7d53-480c-a145-a4671e659eb6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1578 microversion: 2.1 time: 0.151802 Jun 18 05:23:15.073376 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 449/888] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:14 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:15.941446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:15.942073 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:15.949791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:15.950242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:15.951010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:15.951671 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:16.081128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:16.090435 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:16.091044 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:16.094839 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ed3c9ea4-459c-45d7-855f-a4f1f5fbbfea tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1520 microversion: 2.1 time: 0.156058 Jun 18 05:23:16.094839 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 440/889] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:15 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:16.097998 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:16.098472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:16.099246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:16.099686 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:16.358193 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-f8cfb15e-76ae-4c94-b4d6-2c27476f200d req-9419aae5-f3f4-447a-bd55-9b602f055cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b2fdbe-e24f-4092-bf52-db5c0a24f250", "name": "network-vif-deleted", "tag": "f8f8ec04-f267-4e2c-ac94-64d18aec5016"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:16.366486 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-f8cfb15e-76ae-4c94-b4d6-2c27476f200d req-9419aae5-f3f4-447a-bd55-9b602f055cf7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:16.366923 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-f8cfb15e-76ae-4c94-b4d6-2c27476f200d req-9419aae5-f3f4-447a-bd55-9b602f055cf7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:16.378250 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-f8cfb15e-76ae-4c94-b4d6-2c27476f200d req-9419aae5-f3f4-447a-bd55-9b602f055cf7 service nova] Creating event network-vif-deleted:f8f8ec04-f267-4e2c-ac94-64d18aec5016 for instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 on hv-cinder-83699 Jun 18 05:23:16.383969 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-f8cfb15e-76ae-4c94-b4d6-2c27476f200d req-9419aae5-f3f4-447a-bd55-9b602f055cf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029944 Jun 18 05:23:16.384565 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 441/890] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:23:16.413929 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:16.421972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-95c6df81-65e5-4ce9-98b1-098090659f8c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1578 microversion: 2.1 time: 0.335299 Jun 18 05:23:16.432397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 450/891] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:16 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1578 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:17.111771 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:17.112573 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:17.119979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:17.120434 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:17.121206 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:17.121669 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:17.156015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:17.156468 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:17.156921 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lazy-loading 'fault' on Instance uuid 73b2fdbe-e24f-4092-bf52-db5c0a24f250 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:17.204574 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216d2b492c55410d9563051142048160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8820096253064e5abbe50f23bdc3ebac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:17.213479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d787749b-5e42-46c8-8631-3906b920f13c tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 200 len: 1311 microversion: 2.1 time: 0.105946 Jun 18 05:23:17.214079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 442/892] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:17 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:17.439514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:17.444654 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:17.446910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:17.447361 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:17.448130 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:17.448739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:17.518299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:17.520619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:17.527054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8a81e7af-61a4-406e-963a-932ed0f602ef tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1510 microversion: 2.1 time: 0.091442 Jun 18 05:23:17.527627 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 451/893] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:17 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1510 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:18.235922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:18.236541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] [instance: 73b2fdbe-e24f-4092-bf52-db5c0a24f250] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:18.244199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:18.244898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:18.245718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:18.246158 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:18.260894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] HTTP exception thrown: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 could not be found. Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Request method failure captured: Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 HTTP/1.1 Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWAJTmp380dwdux2DLXsjuCyStbEwHWeVdk1L8sPhOY-wMgt-oCcWucBg5mR83XOLVrNVoiU2W3UcaCweUZEXENzGwjYzcjFATyv5s4j9ODrKTRUVkasIbCgO3KpsyDUdpVUraDNk4_KY4ro-hkG4XupJZ8dnfrS-1kqTxoStVmDU0g Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:23:18.262606 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8820096253064e5abbe50f23bdc3ebac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8820096253064e5abbe50f23bdc3ebac"}]}] Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 8820096253064e5abbe50f23bdc3ebac Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1272623576 Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 216d2b492c55410d9563051142048160 Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1272623576-project Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 could not be found. Jun 18 05:23:18.263985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '73b2fdbe-e24f-4092-bf52-db5c0a24f250'} Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 could not be found. Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:18.264877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 could not be found. Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 could not be found. Jun 18 05:23:18.266493 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:18.267924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] Returning 404 to user: Instance 73b2fdbe-e24f-4092-bf52-db5c0a24f250 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:18.267924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e7651ca5-b8cc-47e8-b1fb-9bb0d3f19138 tempest-ServerRescueNegativeTestJSON-1272623576 tempest-ServerRescueNegativeTestJSON-1272623576-project] 10.222.0.23 "GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250" status: 404 len: 111 microversion: 2.1 time: 0.032277 Jun 18 05:23:18.267924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 443/894] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:18 2022] GET /compute/v2.1/servers/73b2fdbe-e24f-4092-bf52-db5c0a24f250 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:18.417920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-5624c90e-96e4-48fa-9e87-b066f17412a8 req-5d0be62d-3aaf-41f0-9d70-6d18a4220549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0862f974-0f40-4c61-95a9-9c0e1db65a4b", "name": "network-vif-deleted", "tag": "23c6b7c7-2045-4a84-955e-c924bc121496"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:18.426416 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-5624c90e-96e4-48fa-9e87-b066f17412a8 req-5d0be62d-3aaf-41f0-9d70-6d18a4220549 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:18.427001 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-5624c90e-96e4-48fa-9e87-b066f17412a8 req-5d0be62d-3aaf-41f0-9d70-6d18a4220549 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:18.438577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-5624c90e-96e4-48fa-9e87-b066f17412a8 req-5d0be62d-3aaf-41f0-9d70-6d18a4220549 service nova] Creating event network-vif-deleted:23c6b7c7-2045-4a84-955e-c924bc121496 for instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b on hv-cinder-83699 Jun 18 05:23:18.444957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-5624c90e-96e4-48fa-9e87-b066f17412a8 req-5d0be62d-3aaf-41f0-9d70-6d18a4220549 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Jun 18 05:23:18.446008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 452/895] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:18.545141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:18.545913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:18.552474 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:18.553601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:18.554421 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:18.554881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:18.588188 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:18.588633 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:18.589079 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lazy-loading 'fault' on Instance uuid 0862f974-0f40-4c61-95a9-9c0e1db65a4b {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:18.642416 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:18.651022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e44cd2c7-5bb4-4de7-853a-66ae5f163ac1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 200 len: 1230 microversion: 2.1 time: 0.110134 Jun 18 05:23:18.651825 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 444/896] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:18 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:19.671412 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:19.671998 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:19.680466 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:19.680903 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:19.681743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:19.682169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:19.698088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] HTTP exception thrown: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Request method failure captured: Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b HTTP/1.1 Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWCHsrCn9xlk1TNZ9USpUNzb5tvtDu_IkeuwTJpOlCYXmHscAEjuydQ1EsKAkdbsHtKYQNeoxLdqk85fxrbMZwr9vlkecJe2CElokjPd0pLz17bVMz_jDrmW4H-NtnSSYqjNzMNBdihz36D0qCQT4FBhasjFkcfmE6wVSFIEumbuAYg Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:19.699753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5e4aece32ff462b9b9a42200d584c1b"}]}] Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 6d24c8fbdc7246e2af87004f2985a9f5 Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:23:19.701323 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '0862f974-0f40-4c61-95a9-9c0e1db65a4b'} Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:19.702257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:23:19.703740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:19.705015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Returning 404 to user: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:19.705015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-726aa7c6-1f94-4fb7-90aa-4bbb543f933f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 404 len: 111 microversion: 2.1 time: 0.034299 Jun 18 05:23:19.705711 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 453/897] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:19 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:19.806293 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1887146470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-330640060", "security_groups": [{"name": "tempest-secgroup-smoke-1088067478"}], "block_device_mapping_v2": [{"uuid": "0472eee7-1c5d-47b6-ac58-689c18a17356", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1df631c6-dcd7-4307-8f3b-f75e299e78ec"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:20.017747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] validate_networks() for [('1df631c6-dcd7-4307-8f3b-f75e299e78ec', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:23:20.704179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:23:20.704179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:23:20.704653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:23:20.705063 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:23:20.705514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:23:20.715962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:20.716443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:20.717371 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:20.718019 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:20.738356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:23:20.742866 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for user 6d24c8fbdc7246e2af87004f2985a9f5 and project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:23:20.810832 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:23:20.814371 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0472eee7-1c5d-47b6-ac58-689c18a17356',volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:23:21.174570 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-13a7be68-2628-45e1-974c-176bbe85edfc tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.372809 Jun 18 05:23:21.175232 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 445/898] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:23:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:23:21.186827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-73d1c2ed-ca70-4d8c-8b9e-9a31707506d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:21.190570 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-73d1c2ed-ca70-4d8c-8b9e-9a31707506d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:21.195208 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:21.247345 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-73d1c2ed-ca70-4d8c-8b9e-9a31707506d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:21.255773 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-73d1c2ed-ca70-4d8c-8b9e-9a31707506d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1094 microversion: 2.1 time: 0.073539 Jun 18 05:23:21.276035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 454/899] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:21 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:22.274225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:22.274896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:22.283905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:22.283905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:22.283905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:22.283905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:22.377863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:22.391330 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cb60d7dd-3209-4b5b-b949-25bfe38746d5 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1144 microversion: 2.1 time: 0.122554 Jun 18 05:23:22.391912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 446/900] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:22 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:23.410065 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:23.410828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:23.419925 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:23.420607 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:23.421367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:23.422117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:23.501211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:23.508820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3946f0b2-71cb-48eb-99fc-1e9d44b4df38 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1192 microversion: 2.1 time: 0.103116 Jun 18 05:23:23.509405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 455/901] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:23 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:24.191561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:24.193366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:24.200265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.200714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.201648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.202177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.233456 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fda5abaf-b6c5-4a37-aa3e-10161e5df60d tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045888 Jun 18 05:23:24.234169 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 447/902] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:23:24 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:24.382743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:24.388840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:24.391759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.392201 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.393006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.393459 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.433805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ec426294-ee42-4c56-bb36-3f8d9b497fac tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/2c4342f2-cacf-4b1f-bf1c-a1970278bf27" status: 200 len: 194 microversion: 2.1 time: 0.059211 Jun 18 05:23:24.435160 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 456/903] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Jun 18 05:23:24 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/2c4342f2-cacf-4b1f-bf1c-a1970278bf27 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:24.447968 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:24.448593 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:24.455327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.456109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.456974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.457524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.538819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:24.539972 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:24.555816 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.557899 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.558828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:24.559285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:24.599479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:24.603159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lazy-loading 'services' on Instance uuid b8e4e387-f80d-4ab4-b84b-8e300ba1691b {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:24.660308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:24.667619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-84de1735-9b38-463e-a5cd-7347afeea39c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1210 microversion: 2.1 time: 0.137999 Jun 18 05:23:24.668478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 457/904] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:24 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:24.820953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-78c901be-7994-4d39-a18e-d41ed871fad8 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/2c4342f2-cacf-4b1f-bf1c-a1970278bf27" status: 202 len: 0 microversion: 2.1 time: 0.377581 Jun 18 05:23:24.821791 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 448/905] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:23:24 2022] DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/2c4342f2-cacf-4b1f-bf1c-a1970278bf27 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:23:25.693795 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:25.694702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:25.705859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:25.706306 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:25.707084 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:25.707518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:25.901077 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:25.911480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2bd90412-877b-4c41-bcd6-3de255771c2a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1278 microversion: 2.1 time: 0.221469 Jun 18 05:23:25.912578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 458/906] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:25 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:26.098783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-ed797da2-4c31-4b44-89ca-366ecac5a026 req-d3a7b22f-63d0-40de-99e8-872cca5879ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d167251a-f398-4442-a5b0-f75ab2d4d1b4", "tag": "f1e35c87-41ca-48fb-a045-921ff1c239b0"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:26.115805 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-ed797da2-4c31-4b44-89ca-366ecac5a026 req-d3a7b22f-63d0-40de-99e8-872cca5879ed service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:26.116248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-ed797da2-4c31-4b44-89ca-366ecac5a026 req-d3a7b22f-63d0-40de-99e8-872cca5879ed service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:26.136328 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-ed797da2-4c31-4b44-89ca-366ecac5a026 req-d3a7b22f-63d0-40de-99e8-872cca5879ed service nova] Creating event network-changed:f1e35c87-41ca-48fb-a045-921ff1c239b0 for instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 on hv-cinder-83699 Jun 18 05:23:26.141312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-ed797da2-4c31-4b44-89ca-366ecac5a026 req-d3a7b22f-63d0-40de-99e8-872cca5879ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047815 Jun 18 05:23:26.142352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 449/907] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:26.928582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:26.930744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:26.937572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:26.938895 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:26.948220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:26.948220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:27.012946 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:27.013654 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:27.020775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:27.022508 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:27.022650 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:27.023130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:27.055979 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-52269745-c611-4bd9-9ecd-6d2914f972b3 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/e66e4ed0-157d-4a6e-acbe-0e768a10bc67" status: 200 len: 194 microversion: 2.1 time: 0.047629 Jun 18 05:23:27.056489 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 450/908] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Jun 18 05:23:27 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/e66e4ed0-157d-4a6e-acbe-0e768a10bc67 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:23:27.066203 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:27.066696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:27.073672 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:27.074123 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:27.074900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:27.075332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:27.114509 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:27.122274 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c28e1693-7ac7-48ca-bc94-32053ed2d00d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.197816 Jun 18 05:23:27.122834 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 459/909] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:26 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:27.165333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lazy-loading 'services' on Instance uuid b8e4e387-f80d-4ab4-b84b-8e300ba1691b {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:27.435938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-aa3dca46-7975-4ebe-9abe-c05c0573656f tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/e66e4ed0-157d-4a6e-acbe-0e768a10bc67" status: 202 len: 0 microversion: 2.1 time: 0.373271 Jun 18 05:23:27.436644 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 451/910] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:23:27 2022] DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments/e66e4ed0-157d-4a6e-acbe-0e768a10bc67 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:23:28.140282 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:28.141533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:28.149101 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:28.149806 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:28.150575 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:28.151162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:28.317477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:28.326800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-895bb3ac-83bb-4c38-a38b-bcc641764c1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.190605 Jun 18 05:23:28.327424 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 460/911] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:28 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:29.344901 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:29.345656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:29.353293 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.353792 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.354679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.355143 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.487774 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:29.497100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-757f1843-6db5-476b-af71-9c025ec6c1c8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.156661 Jun 18 05:23:29.497716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 452/912] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:29 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:29.657539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:29.658522 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:29.665030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.665517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.666276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.666709 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.695295 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c94a2272-462e-41cb-96e5-ad3a38c22e93 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041995 Jun 18 05:23:29.695830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 461/913] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:23:29 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:23:29.807167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:29.808156 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:29.814242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.815664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.815664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.815980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.846723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-374dd0e3-253c-4fc6-b932-889a405303e5 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043392 Jun 18 05:23:29.846723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 453/914] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:23:29 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:23:29.906283 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:29.906785 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:29.913327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.913805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.914573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:29.915011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:29.940344 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:23:30.360114 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-12e06b74-fa0d-40b2-a9a5-fda90664bc56 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 204 len: 0 microversion: 2.1 time: 0.458291 Jun 18 05:23:30.360635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 462/915] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:23:29 2022] DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:23:30.369711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:30.370319 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:30.376938 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:30.377407 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:30.378222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:30.378661 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:30.511083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:30.514220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:30.514934 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:30.518900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6effa330-919a-4e25-8bf2-e6d7d20a7a84 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1673 microversion: 2.1 time: 0.153942 Jun 18 05:23:30.519562 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 454/916] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:30 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:30.520886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:30.521340 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:30.522373 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:30.522605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:30.653437 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:30.661245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ef9c2bb3-39e0-47d6-babf-e593aaa55606 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.151230 Jun 18 05:23:30.662734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 463/917] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:30 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:31.536490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:31.537100 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:31.539049 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:31.539711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:31.545045 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:31.545541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:31.546283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:31.546717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:31.678704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:31.681093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:31.681729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:31.684103 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:31.686897 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2abc26e5-f0d9-4357-bc12-8287b0388482 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1673 microversion: 2.1 time: 0.154240 Jun 18 05:23:31.687783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 455/918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:31 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:31.688845 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:31.689288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:31.690087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:31.690517 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:31.821957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:31.829325 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1d012020-f6cf-4fa0-af75-45461de68b66 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.153190 Jun 18 05:23:31.829913 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 464/919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:31 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:32.703458 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:32.704155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:32.711216 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:32.711708 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:32.712473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:32.712904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:32.843994 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:32.846300 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:32.846988 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:32.852129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4c27a884-4202-4df2-a11f-0491237fa6c7 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1673 microversion: 2.1 time: 0.152568 Jun 18 05:23:32.852692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 456/920] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:32 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:32.854777 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:32.859333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:32.859333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:32.859333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:32.989703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:32.998097 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bcf9e392-a382-4cb7-80cd-77ddad66fa1c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.155792 Jun 18 05:23:32.998671 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 465/921] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:32 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:33.875026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:33.875649 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:33.883148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:33.883602 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:33.884378 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:33.884816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:33.954941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:33.963694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d1659ea6-fbad-4257-9930-f62464d8c61e tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1606 microversion: 2.1 time: 0.092626 Jun 18 05:23:33.964279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 457/922] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:33 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:33.997214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-19f102d1-60d8-4de1-bc6c-af99fc49bd91 req-744c12ba-7ec2-4e92-bbba-41dbcb86f546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e4e387-f80d-4ab4-b84b-8e300ba1691b", "name": "network-vif-deleted", "tag": "de69b734-c483-4ced-a344-3ae592794f9e"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:34.012087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-19f102d1-60d8-4de1-bc6c-af99fc49bd91 req-744c12ba-7ec2-4e92-bbba-41dbcb86f546 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:34.015447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:34.016054 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:34.016835 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-19f102d1-60d8-4de1-bc6c-af99fc49bd91 req-744c12ba-7ec2-4e92-bbba-41dbcb86f546 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:34.023140 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:34.023812 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:34.024886 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:34.025328 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:34.030335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-19f102d1-60d8-4de1-bc6c-af99fc49bd91 req-744c12ba-7ec2-4e92-bbba-41dbcb86f546 service nova] Creating event network-vif-deleted:de69b734-c483-4ced-a344-3ae592794f9e for instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b on hv-cinder-83699 Jun 18 05:23:34.035683 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-19f102d1-60d8-4de1-bc6c-af99fc49bd91 req-744c12ba-7ec2-4e92-bbba-41dbcb86f546 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043465 Jun 18 05:23:34.036673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 466/923] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:34.202343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:34.211376 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-494542d4-947c-4a53-87ba-de0202488cae tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.199817 Jun 18 05:23:34.221972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 458/924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:34 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:23:34.985701 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:34.987498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:34.998285 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:34.999374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:35.000982 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:35.001827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:35.046279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:35.046759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:35.047279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lazy-loading 'fault' on Instance uuid b8e4e387-f80d-4ab4-b84b-8e300ba1691b {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:35.104234 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c8f964ee6a49cda501ed28a9432c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969c470f720c4b2f97ba9f45c5d0d426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:35.112366 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d75c1318-72c2-47c0-b0f6-bf6a77406ccc tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 200 len: 1326 microversion: 2.1 time: 0.133264 Jun 18 05:23:35.112366 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 467/925] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:34 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:35.230256 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:35.230876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:35.237435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:35.238092 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:35.239045 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:35.239484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:35.401955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:35.410144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ccf63901-7902-4866-afa7-255855a6aae1 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.184071 Jun 18 05:23:35.410712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 459/926] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:35 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:36.128005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:36.128705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:36.135423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:36.136090 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:36.136848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:36.137238 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:36.300272 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] HTTP exception thrown: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Request method failure captured: Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b HTTP/1.1 Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-5q0OQRNSvZuzDq5wNwJhQN4vSWSRPqFYSVXo3ZNkdlXQDN3eDPoi7ud5Ntlqe8eP81bU_O-PlL54ZNkYt_Zt5GVj-8rUBiJIWgH6uSgD3PWXj5P7qe-dj6g-lff1SpM-EWLHBqqvWHlqX1aB-G6YkJZNja4cS4AmrKG_DXe1fkUM Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:36.301960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969c470f720c4b2f97ba9f45c5d0d426"}]}] Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: d2c8f964ee6a49cda501ed28a9432c8e Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:36.303863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'b8e4e387-f80d-4ab4-b84b-8e300ba1691b'} Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:36.304863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:36.308530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:36.310036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Returning 404 to user: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:36.310036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a06a8770-dceb-4a19-a2f7-418cca3a3284 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 404 len: 111 microversion: 2.1 time: 0.179324 Jun 18 05:23:36.310036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 468/927] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:36 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:36.313920 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b9df692f-37fb-439b-ae4a-091fe7421609 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '.version_select at 0x7f7b01e22ee0>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:36.408730 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b9df692f-37fb-439b-ae4a-091fe7421609 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646326506" status: 202 len: 0 microversion: 2.1 time: 0.099870 Jun 18 05:23:36.409461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 460/928] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Jun 18 05:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646326506 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:23:36.430063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:36.430770 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:36.437660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:36.438176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:36.439456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:36.440088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:36.596249 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:36.605305 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bdd9c29d-5593-4c81-a7d0-f768325bf57a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.180493 Jun 18 05:23:36.605861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 469/929] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:36 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:36.875112 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-8be435f8-29e9-4e50-b843-4aecd08a0e82 req-37bff38a-3e92-4300-9fd6-518ba2ca8325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d167251a-f398-4442-a5b0-f75ab2d4d1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f1e35c87-41ca-48fb-a045-921ff1c239b0"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:36.887170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8be435f8-29e9-4e50-b843-4aecd08a0e82 req-37bff38a-3e92-4300-9fd6-518ba2ca8325 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:36.888084 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8be435f8-29e9-4e50-b843-4aecd08a0e82 req-37bff38a-3e92-4300-9fd6-518ba2ca8325 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:36.900031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-8be435f8-29e9-4e50-b843-4aecd08a0e82 req-37bff38a-3e92-4300-9fd6-518ba2ca8325 service nova] Creating event network-vif-plugged:f1e35c87-41ca-48fb-a045-921ff1c239b0 for instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 on hv-cinder-83699 Jun 18 05:23:36.906101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-8be435f8-29e9-4e50-b843-4aecd08a0e82 req-37bff38a-3e92-4300-9fd6-518ba2ca8325 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034832 Jun 18 05:23:36.907313 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 461/930] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:37.622563 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:37.623170 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:37.629549 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:37.629990 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:37.630740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:37.631230 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:37.635133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:37.767480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:37.775478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7971b1e1-0c7e-42dd-a766-f7588c7de12d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.156711 Jun 18 05:23:37.776023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 470/931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:37 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:38.794792 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:38.795490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:38.801630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:38.802107 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:38.803477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:38.803974 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:38.947841 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:38.955486 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fe5e2aaf-3c7d-4470-a296-692bb9f54d84 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1266 microversion: 2.1 time: 0.165488 Jun 18 05:23:38.956238 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 462/932] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:38 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:39.772933 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:39.773694 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:39.780790 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:39.781307 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:39.782087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:39.782516 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:39.796394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] HTTP exception thrown: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Request method failure captured: Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b HTTP/1.1 Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-5q0OQRNSvZuzDq5wNwJhQN4vSWSRPqFYSVXo3ZNkdlXQDN3eDPoi7ud5Ntlqe8eP81bU_O-PlL54ZNkYt_Zt5GVj-8rUBiJIWgH6uSgD3PWXj5P7qe-dj6g-lff1SpM-EWLHBqqvWHlqX1aB-G6YkJZNja4cS4AmrKG_DXe1fkUM Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:39.798047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969c470f720c4b2f97ba9f45c5d0d426"}]}] Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: d2c8f964ee6a49cda501ed28a9432c8e Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.799613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'b8e4e387-f80d-4ab4-b84b-8e300ba1691b'} Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:39.800555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.802279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.804468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Returning 404 to user: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:39.804468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a5c1b0bd-de61-4910-9549-354b18757240 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 404 len: 111 microversion: 2.1 time: 0.032449 Jun 18 05:23:39.804468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 471/933] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:23:39 2022] DELETE /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:39.808905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:39.809590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: b8e4e387-f80d-4ab4-b84b-8e300ba1691b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:39.816148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:39.816597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:39.817356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:39.817829 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:39.832597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] HTTP exception thrown: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Request method failure captured: Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b HTTP/1.1 Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV-5q0OQRNSvZuzDq5wNwJhQN4vSWSRPqFYSVXo3ZNkdlXQDN3eDPoi7ud5Ntlqe8eP81bU_O-PlL54ZNkYt_Zt5GVj-8rUBiJIWgH6uSgD3PWXj5P7qe-dj6g-lff1SpM-EWLHBqqvWHlqX1aB-G6YkJZNja4cS4AmrKG_DXe1fkUM Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:23:39.832922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969c470f720c4b2f97ba9f45c5d0d426"}]}] Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: d2c8f964ee6a49cda501ed28a9432c8e Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.834538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'b8e4e387-f80d-4ab4-b84b-8e300ba1691b'} Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:39.835444 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. Jun 18 05:23:39.836892 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:39.838745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Returning 404 to user: Instance b8e4e387-f80d-4ab4-b84b-8e300ba1691b could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:39.838745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3b5ebdef-dfbb-475b-ba7b-ddaf1748c875 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b" status: 404 len: 111 microversion: 2.1 time: 0.029779 Jun 18 05:23:39.838745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 463/934] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:39 2022] GET /compute/v2.1/servers/b8e4e387-f80d-4ab4-b84b-8e300ba1691b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:39.972499 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:39.973112 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:39.979817 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:39.980268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:39.981029 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:39.981492 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:40.120083 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:40.133691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2be4c655-6db1-47d9-9591-63bd0d026366 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1453 microversion: 2.1 time: 0.164532 Jun 18 05:23:40.134022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 472/935] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:39 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:40.149699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:40.150343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:40.156847 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:40.157300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:40.158880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:40.158880 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:40.292288 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:40.299939 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3a2ee1f1-59a1-49ce-845b-0e081bb54586 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1453 microversion: 2.1 time: 0.154853 Jun 18 05:23:40.300503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 464/936] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:40 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:41.126456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:41.126975 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:41.145374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:41.145374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:41.145374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:41.145374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:41.150842 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] HTTP exception thrown: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Request method failure captured: Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 HTTP/1.1 Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-5q0OQRNSvZuzDq5wNwJhQN4vSWSRPqFYSVXo3ZNkdlXQDN3eDPoi7ud5Ntlqe8eP81bU_O-PlL54ZNkYt_Zt5GVj-8rUBiJIWgH6uSgD3PWXj5P7qe-dj6g-lff1SpM-EWLHBqqvWHlqX1aB-G6YkJZNja4cS4AmrKG_DXe1fkUM Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:41.152410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969c470f720c4b2f97ba9f45c5d0d426"}]}] Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: d2c8f964ee6a49cda501ed28a9432c8e Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.153992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '240d96c6-c2da-4ee1-8fd9-554944f65d95'} Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:41.154999 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.156174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.158558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Returning 404 to user: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:41.159397 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f00c6cfb-f4c7-4250-bbe5-db96a806f097 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 404 len: 111 microversion: 2.1 time: 0.036781 Jun 18 05:23:41.159945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 473/937] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:23:41 2022] DELETE /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:41.171711 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:41.172337 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] [instance: 240d96c6-c2da-4ee1-8fd9-554944f65d95] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:41.174840 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:41.198777 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:41.206018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:41.207897 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:41.210603 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:41.233726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] HTTP exception thrown: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Request method failure captured: Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 HTTP/1.1 Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV-5q0OQRNSvZuzDq5wNwJhQN4vSWSRPqFYSVXo3ZNkdlXQDN3eDPoi7ud5Ntlqe8eP81bU_O-PlL54ZNkYt_Zt5GVj-8rUBiJIWgH6uSgD3PWXj5P7qe-dj6g-lff1SpM-EWLHBqqvWHlqX1aB-G6YkJZNja4cS4AmrKG_DXe1fkUM Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:23:41.237679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969c470f720c4b2f97ba9f45c5d0d426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969c470f720c4b2f97ba9f45c5d0d426"}]}] Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 969c470f720c4b2f97ba9f45c5d0d426 Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934236616 Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: d2c8f964ee6a49cda501ed28a9432c8e Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeTestJSON-1934236616-project Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.239338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '240d96c6-c2da-4ee1-8fd9-554944f65d95'} Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:41.240915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. Jun 18 05:23:41.243653 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:41.247837 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] Returning 404 to user: Instance 240d96c6-c2da-4ee1-8fd9-554944f65d95 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:41.249093 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-99eea25b-d0cf-4801-839c-542028de7b40 tempest-AttachVolumeTestJSON-1934236616 tempest-AttachVolumeTestJSON-1934236616-project] 10.222.0.23 "GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95" status: 404 len: 111 microversion: 2.1 time: 0.084192 Jun 18 05:23:41.254202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 465/938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:41 2022] GET /compute/v2.1/servers/240d96c6-c2da-4ee1-8fd9-554944f65d95 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:23:43.626987 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-0ac12d1c-7727-42f1-9b69-a343a013cbf5 req-d399e1cd-3259-41d3-9980-32c109f2d476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d167251a-f398-4442-a5b0-f75ab2d4d1b4", "tag": "f1e35c87-41ca-48fb-a045-921ff1c239b0"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:43.635888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0ac12d1c-7727-42f1-9b69-a343a013cbf5 req-d399e1cd-3259-41d3-9980-32c109f2d476 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:43.636575 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-0ac12d1c-7727-42f1-9b69-a343a013cbf5 req-d399e1cd-3259-41d3-9980-32c109f2d476 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:43.648602 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-0ac12d1c-7727-42f1-9b69-a343a013cbf5 req-d399e1cd-3259-41d3-9980-32c109f2d476 service nova] Creating event network-changed:f1e35c87-41ca-48fb-a045-921ff1c239b0 for instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 on hv-cinder-83699 Jun 18 05:23:43.654181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-0ac12d1c-7727-42f1-9b69-a343a013cbf5 req-d399e1cd-3259-41d3-9980-32c109f2d476 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330030 Jun 18 05:23:43.655867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 474/939] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:44.434510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:44.435533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:44.451184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:44.451184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:44.451184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:44.451184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:44.499670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5d5f18c9-a33c-46e2-bbd7-eb86d1af64b0 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069843 Jun 18 05:23:44.507625 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 466/940] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 05:23:44 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:23:44.597353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:44.597353 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:44.606117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:44.606847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:44.607831 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:44.608507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:44.643425 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:23:44.956038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7047243e-72ad-42e3-8be5-be75cc82e4e5 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 204 len: 0 microversion: 2.20 time: 0.367546 Jun 18 05:23:44.957120 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 475/941] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 05:23:44 2022] DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 05:23:44.965585 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:44.966471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:44.973609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:44.975055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:44.975990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:44.976570 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:45.131542 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:45.134953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:45.139719 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:45.141231 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:45.142420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5340fdcb-f5e4-4376-ac7e-a7b42abda48b tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.181166 Jun 18 05:23:45.145745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 467/942] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:44 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:46.161527 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:46.162901 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:46.170251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:46.170705 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:46.172226 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:46.172844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:46.332538 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:46.345703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:46.347147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:46.348638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-786fec9b-8440-4b08-bd3d-d19be45388da tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1722 microversion: 2.20 time: 0.191385 Jun 18 05:23:46.360490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 476/943] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:46 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:47.370022 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:47.371303 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:47.399240 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:47.399240 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:47.399240 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:47.399240 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:47.524098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-91d795da-4dda-4304-ad8f-3041fdfa0c0f req-4e3ad06c-8360-40cf-99de-78cbf9dead32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae5a59b-afc4-4fa7-a230-8590a793bc48", "name": "network-vif-deleted", "tag": "d9715080-f281-4e80-b712-b6d751681e6f"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:47.527449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:47.540020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:47.540927 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-91d795da-4dda-4304-ad8f-3041fdfa0c0f req-4e3ad06c-8360-40cf-99de-78cbf9dead32 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:47.541729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:47.554335 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-91d795da-4dda-4304-ad8f-3041fdfa0c0f req-4e3ad06c-8360-40cf-99de-78cbf9dead32 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:47.554630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fd379d05-b7ee-4bd8-859e-2ee854b44e74 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1655 microversion: 2.20 time: 0.179966 Jun 18 05:23:47.554630 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 468/944] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:47 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:47.560236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-91d795da-4dda-4304-ad8f-3041fdfa0c0f req-4e3ad06c-8360-40cf-99de-78cbf9dead32 service nova] Creating event network-vif-deleted:d9715080-f281-4e80-b712-b6d751681e6f for instance bae5a59b-afc4-4fa7-a230-8590a793bc48 on hv-cinder-83699 Jun 18 05:23:47.572729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-91d795da-4dda-4304-ad8f-3041fdfa0c0f req-4e3ad06c-8360-40cf-99de-78cbf9dead32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049491 Jun 18 05:23:47.572729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 477/945] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:48.565483 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:48.566678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:48.586346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:48.596391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:48.597442 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:48.600779 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:48.646477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:48.647085 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:48.649530 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lazy-loading 'fault' on Instance uuid bae5a59b-afc4-4fa7-a230-8590a793bc48 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:23:48.697789 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:48.707190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:48.708844 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0f3999a062e45748878a3204e3ea456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758883a5aea04c85ad65bb6970bdb098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:48.710139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-22553de7-446a-4986-88cb-e8e424f8a313 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 200 len: 1371 microversion: 2.20 time: 0.152180 Jun 18 05:23:48.710692 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 469/946] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:48 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 05:23:49.733568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:49.734321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:49.741529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:49.741971 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:49.742723 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:49.743152 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:49.756301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] HTTP exception thrown: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Request method failure captured: Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 HTTP/1.1 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-6UTMfRwTaSNYnxWMUh0XY444wsVOavr6__ryX2jxMDL0Dgrhi5nxgeT_COG_Bxy0u6j_HDC7he36s36IlUkLywrpEoM9AzbqZEW7eZIZX_PvTEAZ2weVZNj4ScmAdJnQlzvhX1qWxTA0pXOSESe9lFsd6QK9kP3rju9KNdovXMUo Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:49.757973 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/758883a5aea04c85ad65bb6970bdb098"}]}] Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e0f3999a062e45748878a3204e3ea456 Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:49.760662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'bae5a59b-afc4-4fa7-a230-8590a793bc48'} Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:49.761569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:49.763058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:49.764505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Returning 404 to user: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:49.764505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-14470435-b14a-4999-8a94-df096078640c tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 404 len: 111 microversion: 2.20 time: 0.031030 Jun 18 05:23:49.764505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 478/947] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:49 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 18 05:23:49.768656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-478a7bb2-f69f-446d-9306-07c4605abaaf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '.version_select at 0x7f7b01e78b80>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:49.892168 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-478a7bb2-f69f-446d-9306-07c4605abaaf tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929894634" status: 204 len: 0 microversion: 2.20 time: 0.127454 Jun 18 05:23:49.892747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 470/948] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Jun 18 05:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929894634 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 05:23:52.302168 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:52.303379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:52.310583 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:52.311032 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:52.311852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:52.312286 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:52.329068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] HTTP exception thrown: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Request method failure captured: Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 HTTP/1.1 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-6UTMfRwTaSNYnxWMUh0XY444wsVOavr6__ryX2jxMDL0Dgrhi5nxgeT_COG_Bxy0u6j_HDC7he36s36IlUkLywrpEoM9AzbqZEW7eZIZX_PvTEAZ2weVZNj4ScmAdJnQlzvhX1qWxTA0pXOSESe9lFsd6QK9kP3rju9KNdovXMUo Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:52.331385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/758883a5aea04c85ad65bb6970bdb098"}]}] Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e0f3999a062e45748878a3204e3ea456 Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.333253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'bae5a59b-afc4-4fa7-a230-8590a793bc48'} Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:52.335537 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.336991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.338507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Returning 404 to user: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:52.338507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c568c410-edf6-41a6-afcd-606a38281ea9 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 404 len: 111 microversion: 2.20 time: 0.035025 Jun 18 05:23:52.338507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 479/949] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 05:23:52 2022] DELETE /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:23:52.342679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:52.343163 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: bae5a59b-afc4-4fa7-a230-8590a793bc48] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:52.351349 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:52.351794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:52.352582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:52.353020 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:52.369729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] HTTP exception thrown: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Request method failure captured: Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 HTTP/1.1 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV-6UTMfRwTaSNYnxWMUh0XY444wsVOavr6__ryX2jxMDL0Dgrhi5nxgeT_COG_Bxy0u6j_HDC7he36s36IlUkLywrpEoM9AzbqZEW7eZIZX_PvTEAZ2weVZNj4ScmAdJnQlzvhX1qWxTA0pXOSESe9lFsd6QK9kP3rju9KNdovXMUo Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:23:52.371312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/758883a5aea04c85ad65bb6970bdb098"}]}] Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: e0f3999a062e45748878a3204e3ea456 Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.372975 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'bae5a59b-afc4-4fa7-a230-8590a793bc48'} Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:52.373816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. Jun 18 05:23:52.375133 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:52.376229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Returning 404 to user: Instance bae5a59b-afc4-4fa7-a230-8590a793bc48 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:52.376229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-02c6cc42-e1f7-4517-abe3-6dd6f9a26b57 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48" status: 404 len: 111 microversion: 2.20 time: 0.034141 Jun 18 05:23:52.376229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 471/950] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:52 2022] GET /compute/v2.1/servers/bae5a59b-afc4-4fa7-a230-8590a793bc48 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:23:53.663013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:53.663668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:53.673223 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:23:53.678183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:53.678183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:53.678183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:53.678183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:53.701194 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] HTTP exception thrown: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Request method failure captured: Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e HTTP/1.1 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirV-6UTMfRwTaSNYnxWMUh0XY444wsVOavr6__ryX2jxMDL0Dgrhi5nxgeT_COG_Bxy0u6j_HDC7he36s36IlUkLywrpEoM9AzbqZEW7eZIZX_PvTEAZ2weVZNj4ScmAdJnQlzvhX1qWxTA0pXOSESe9lFsd6QK9kP3rju9KNdovXMUo Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:23:53.703196 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/758883a5aea04c85ad65bb6970bdb098"}]}] Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e0f3999a062e45748878a3204e3ea456 Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.707746 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '3db86af8-06be-4481-ae05-85abb634d58e'} Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:53.708479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.710494 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.711737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Returning 404 to user: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:53.711737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7cdde4b7-f77e-41b2-9cf1-517b46e307fe tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 404 len: 111 microversion: 2.20 time: 0.048257 Jun 18 05:23:53.711737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 480/951] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 05:23:53 2022] DELETE /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:23:53.715062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:53.715674 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] [instance: 3db86af8-06be-4481-ae05-85abb634d58e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:53.727109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:53.727578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:53.728401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:53.728846 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:53.745004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] HTTP exception thrown: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Request method failure captured: Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e HTTP/1.1 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirV-6UTMfRwTaSNYnxWMUh0XY444wsVOavr6__ryX2jxMDL0Dgrhi5nxgeT_COG_Bxy0u6j_HDC7he36s36IlUkLywrpEoM9AzbqZEW7eZIZX_PvTEAZ2weVZNj4ScmAdJnQlzvhX1qWxTA0pXOSESe9lFsd6QK9kP3rju9KNdovXMUo Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:23:53.746891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_758883a5aea04c85ad65bb6970bdb098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/758883a5aea04c85ad65bb6970bdb098"}]}] Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 758883a5aea04c85ad65bb6970bdb098 Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1470115321 Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: e0f3999a062e45748878a3204e3ea456 Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1470115321-project Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.748398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '3db86af8-06be-4481-ae05-85abb634d58e'} Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:23:53.749181 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. Jun 18 05:23:53.750415 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:23:53.757621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] Returning 404 to user: Instance 3db86af8-06be-4481-ae05-85abb634d58e could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:23:53.758958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-962ae7a5-22a1-4c2a-b106-7a91b6fb6640 tempest-AttachVolumeShelveTestJSON-1470115321 tempest-AttachVolumeShelveTestJSON-1470115321-project] 10.222.0.23 "GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e" status: 404 len: 111 microversion: 2.20 time: 0.048257 Jun 18 05:23:53.764998 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 472/952] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 05:23:53 2022] GET /compute/v2.1/servers/3db86af8-06be-4481-ae05-85abb634d58e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:23:55.120767 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bbee3918-a40d-44f1-a6ad-0ac2aa0c226e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: .version_select at 0x7f7b05f331f0>, body: {"keypair": {"name": "tempest-keypair-71144994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIdwGABUimmd8+ajiMpY+QlEby+iFzr65CY1iC62V4dH9ViJ3CoI0jvaH0jJBZZrld9Vf6OHOTylc5YIEFS2FX3T32eRUZixU3tjntAUSznFbDHh7fKVVT+0uLudEN0QQ=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:55.136199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-bbee3918-a40d-44f1-a6ad-0ac2aa0c226e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:23:55.140550 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-bbee3918-a40d-44f1-a6ad-0ac2aa0c226e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:23:55.269839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bbee3918-a40d-44f1-a6ad-0ac2aa0c226e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.291122 Jun 18 05:23:55.270623 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 481/953] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:23:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:23:58.868906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1674645541", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c244710-1fba-414f-9d04-4fcd88e7ed14"}], "security_groups": [{"name": "tempest-securitygroup--2003866802"}], "key_name": "tempest-keypair-71144994", "user_data": "}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:23:59.056780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] validate_networks() for [('1c244710-1fba-414f-9d04-4fcd88e7ed14', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:23:59.574142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:23:59.574826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:23:59.576188 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:23:59.576601 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:23:59.577019 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:23:59.592069 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:59.593077 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:59.594186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:23:59.595057 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:23:59.631150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:23:59.646607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:23:59.662565 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:23:59.666193 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:23:59.879889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b99d58e8-55cd-4143-a59c-5f095d835f01 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.016353 Jun 18 05:23:59.886212 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 473/954] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:23:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:23:59.893125 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c1ab833b-777d-4555-9a7c-e81987672097 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:23:59.893828 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c1ab833b-777d-4555-9a7c-e81987672097 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:23:59.977029 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c1ab833b-777d-4555-9a7c-e81987672097 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:23:59.984859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c1ab833b-777d-4555-9a7c-e81987672097 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1240 microversion: 2.1 time: 0.097241 Jun 18 05:23:59.985450 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 482/955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:23:59 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:01.003767 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f78cd674-206f-4ca7-8447-248cf6f629ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:01.004383 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f78cd674-206f-4ca7-8447-248cf6f629ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:01.148242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f78cd674-206f-4ca7-8447-248cf6f629ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:01.148242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f78cd674-206f-4ca7-8447-248cf6f629ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1240 microversion: 2.1 time: 0.083073 Jun 18 05:24:01.148242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 474/956] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:00 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:02.161025 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:02.161700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:02.169435 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:02.170013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:02.170763 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:02.171195 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:02.244957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:02.254270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bb6f54da-892f-4002-8220-7c2a4f97fae7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1292 microversion: 2.1 time: 0.097171 Jun 18 05:24:02.258103 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 483/957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:02 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:03.272184 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:03.272949 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:03.279479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:03.282155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:03.282155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:03.282155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:03.353014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:03.361583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-34b3a35d-c7e2-41f9-bc02-0dd64a611d98 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1298 microversion: 2.1 time: 0.093394 Jun 18 05:24:03.373598 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 475/958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:03 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:04.385099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:04.386034 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:04.394015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:04.394741 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:04.395738 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:04.396382 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:04.625764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:04.639555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7eaf95b1-aa36-4363-9896-9bf103fa5a03 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.255559 Jun 18 05:24:04.639555 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 484/959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:04 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:04.801359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-9ea8435d-60c4-4da4-bc02-8d406c3ed31d req-b6467e2a-d129-40b6-a850-cece1fc9b527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589899a5-db4e-4c26-9411-811a83bd6f35", "tag": "10fb6aa3-f962-4d43-b1f4-ceecf7c36670"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:04.813204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-9ea8435d-60c4-4da4-bc02-8d406c3ed31d req-b6467e2a-d129-40b6-a850-cece1fc9b527 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:04.813678 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-9ea8435d-60c4-4da4-bc02-8d406c3ed31d req-b6467e2a-d129-40b6-a850-cece1fc9b527 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:04.839973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-9ea8435d-60c4-4da4-bc02-8d406c3ed31d req-b6467e2a-d129-40b6-a850-cece1fc9b527 service nova] Creating event network-changed:10fb6aa3-f962-4d43-b1f4-ceecf7c36670 for instance 589899a5-db4e-4c26-9411-811a83bd6f35 on hv-cinder-83699 Jun 18 05:24:04.842990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-9ea8435d-60c4-4da4-bc02-8d406c3ed31d req-b6467e2a-d129-40b6-a850-cece1fc9b527 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046319 Jun 18 05:24:04.843590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 476/960] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:05.656039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:05.656657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:05.663642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:05.665236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:05.665236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:05.665477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:05.893495 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:05.900986 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-374bef31-437b-4c33-908c-d18d23123eeb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.249188 Jun 18 05:24:05.906246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 485/961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:05 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:06.919096 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:06.919896 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:06.926116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:06.926632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:06.927675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:06.928118 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:07.059753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:07.067136 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-56b3b903-4e01-4e6c-80eb-2b4025a60821 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.152744 Jun 18 05:24:07.067768 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 477/962] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:06 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:08.084568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:08.085180 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:08.091706 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:08.092156 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:08.092921 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:08.093356 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:08.224408 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:08.231801 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8dd99c5b-76d7-4cc1-876b-b1753ceed4af tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.151567 Jun 18 05:24:08.232358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 486/963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:08 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:09.247863 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:09.248476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:09.255326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:09.255833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:09.256609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:09.257071 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:09.389283 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:09.397903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-43c9e2f7-69cc-44c6-a1d8-259d3d109bf5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.153900 Jun 18 05:24:09.398702 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 478/964] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:09 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:10.416058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:10.416664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:10.419011 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=6 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:10.423820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:10.424264 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:10.425016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:10.425470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:10.429310 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:10.554924 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:10.562446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-fde3ab9b-adac-4a04-9c90-05b2f88e351a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.151198 Jun 18 05:24:10.563005 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 487/965] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:10 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:10.738141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-107859508", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "networks": [{"uuid": "a7bf14ab-72b2-42a1-a57f-14612ca15e66"}]}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:10.745611 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:10.793324 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] validate_networks() for [('a7bf14ab-72b2-42a1-a57f-14612ca15e66', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:24:11.079076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=8 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:11.154352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:24:11.154796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:24:11.155548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:24:11.155947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:24:11.156350 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:24:11.165312 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:11.165723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:11.166503 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:11.166958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:11.184894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Getting quotas for project d8863ced0efc4b95806761cc2d8a6f78. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:24:11.189823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Getting quotas for user f54c1aed6a784e40952d38784bf4ed6b and project d8863ced0efc4b95806761cc2d8a6f78. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:24:11.202782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:24:11.211392 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:24:11.350115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8fc90600-09dd-4baf-b6df-adc19bea22cb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615829 Jun 18 05:24:11.350807 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 479/966] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:24:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:24:11.360715 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ae1b3d94-b195-444d-90df-29b7de35cfec tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:11.361331 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ae1b3d94-b195-444d-90df-29b7de35cfec tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:11.421079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ae1b3d94-b195-444d-90df-29b7de35cfec tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:11.428583 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ae1b3d94-b195-444d-90df-29b7de35cfec tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1218 microversion: 2.1 time: 0.071573 Jun 18 05:24:11.429321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 488/967] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:11 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:11.578770 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:11.579426 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:11.588510 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:11.588954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:11.589981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:11.590167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:11.722134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:11.729875 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e6b9ba2d-ffa0-4b6c-a2d9-9372af43a0eb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.154879 Jun 18 05:24:11.730662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 480/968] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:11 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:11.751971 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-94bea92c-b1da-4b36-8459-2238c20c056a req-15784020-d753-4a05-9bd2-6b9fca6803e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589899a5-db4e-4c26-9411-811a83bd6f35", "name": "network-vif-plugged", "status": "completed", "tag": "10fb6aa3-f962-4d43-b1f4-ceecf7c36670"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:11.762633 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-94bea92c-b1da-4b36-8459-2238c20c056a req-15784020-d753-4a05-9bd2-6b9fca6803e1 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:11.763195 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-94bea92c-b1da-4b36-8459-2238c20c056a req-15784020-d753-4a05-9bd2-6b9fca6803e1 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:11.774330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-94bea92c-b1da-4b36-8459-2238c20c056a req-15784020-d753-4a05-9bd2-6b9fca6803e1 service nova] Creating event network-vif-plugged:10fb6aa3-f962-4d43-b1f4-ceecf7c36670 for instance 589899a5-db4e-4c26-9411-811a83bd6f35 on hv-cinder-83699 Jun 18 05:24:11.779789 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-94bea92c-b1da-4b36-8459-2238c20c056a req-15784020-d753-4a05-9bd2-6b9fca6803e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 Jun 18 05:24:11.781093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 489/969] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:12.445540 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:12.446155 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:12.452699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:12.453144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:12.453941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:12.454374 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:12.517936 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:12.526171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8a5ed642-3361-4b79-8545-597a78c15272 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1222 microversion: 2.1 time: 0.084499 Jun 18 05:24:12.526778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 481/970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:12 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:12.747737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:12.748363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:12.754549 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:12.755502 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:12.756267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:12.756701 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:12.883906 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:12.891539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7971f748-d25b-48b9-b3d4-d6a4ac1e181d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1366 microversion: 2.1 time: 0.148540 Jun 18 05:24:12.892208 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 490/971] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:12 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:13.543196 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:13.543826 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:13.550304 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:13.550752 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:13.551512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:13.552546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:13.611997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:13.619954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9b08183f-3865-4fd4-a7c9-9ee4509c068f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1270 microversion: 2.1 time: 0.080680 Jun 18 05:24:13.620519 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 482/972] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:13 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:13.908860 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:13.909440 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:13.916400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:13.916847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:13.921909 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:13.921909 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:14.048198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:14.055677 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-75b41f77-bcfa-40be-ae03-621c07c39fbb tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1557 microversion: 2.1 time: 0.150985 Jun 18 05:24:14.056247 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 491/973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:13 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:14.072597 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:14.075252 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:14.079219 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:14.079719 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:14.080484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:14.080922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:14.158853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ff1865d2-3c04-442d-8617-b9208d84fed8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090167 Jun 18 05:24:14.159504 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 483/974] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:24:14 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:14.636936 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:14.638255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:14.645273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:14.646256 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:14.647247 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:14.648200 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:14.793687 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:14.804965 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-90f450d2-107d-45ec-a8a2-dcd9d1ced22a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1288 microversion: 2.1 time: 0.171984 Jun 18 05:24:14.805599 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 492/975] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:14 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1288 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:15.523335 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-fe525ff8-935e-43df-9677-8ea7cec0d640 req-a7c4353e-e403-4ae6-a6bf-7d2fa45b0d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589899a5-db4e-4c26-9411-811a83bd6f35", "tag": "10fb6aa3-f962-4d43-b1f4-ceecf7c36670"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:15.531579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-fe525ff8-935e-43df-9677-8ea7cec0d640 req-a7c4353e-e403-4ae6-a6bf-7d2fa45b0d8e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:15.532033 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-fe525ff8-935e-43df-9677-8ea7cec0d640 req-a7c4353e-e403-4ae6-a6bf-7d2fa45b0d8e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:15.547129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-fe525ff8-935e-43df-9677-8ea7cec0d640 req-a7c4353e-e403-4ae6-a6bf-7d2fa45b0d8e service nova] Creating event network-changed:10fb6aa3-f962-4d43-b1f4-ceecf7c36670 for instance 589899a5-db4e-4c26-9411-811a83bd6f35 on hv-cinder-83699 Jun 18 05:24:15.549068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-fe525ff8-935e-43df-9677-8ea7cec0d640 req-a7c4353e-e403-4ae6-a6bf-7d2fa45b0d8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030789 Jun 18 05:24:15.549727 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 484/976] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:15.822635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:15.823822 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:15.830665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:15.831306 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:15.832097 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:15.832713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:16.141133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:16.149700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-81e1b8ea-40ab-4378-8b81-0d0dc81fa8c9 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.330781 Jun 18 05:24:16.162084 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 493/977] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:15 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:16.810545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-dbf2ba84-f379-4263-80fe-2a760489d40a req-cd0cabb0-8518-478b-b04b-4d854710b997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f110a7a4-de6a-4986-b264-d09af210aaa7", "tag": "f108c405-22fa-4032-b9a5-fc33f14813ab"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:16.820248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-dbf2ba84-f379-4263-80fe-2a760489d40a req-cd0cabb0-8518-478b-b04b-4d854710b997 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:16.820700 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-dbf2ba84-f379-4263-80fe-2a760489d40a req-cd0cabb0-8518-478b-b04b-4d854710b997 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:16.832247 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-dbf2ba84-f379-4263-80fe-2a760489d40a req-cd0cabb0-8518-478b-b04b-4d854710b997 service nova] Creating event network-changed:f108c405-22fa-4032-b9a5-fc33f14813ab for instance f110a7a4-de6a-4986-b264-d09af210aaa7 on hv-cinder-83699 Jun 18 05:24:16.837235 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-dbf2ba84-f379-4263-80fe-2a760489d40a req-cd0cabb0-8518-478b-b04b-4d854710b997 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032004 Jun 18 05:24:16.837908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 485/978] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:17.167917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:17.168532 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:17.175254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:17.175707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:17.176473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:17.177581 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:17.396120 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:17.404262 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a2920b54-4615-4c84-a3ce-25f9ce5a4e79 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.240332 Jun 18 05:24:17.404839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 494/979] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:17 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:18.423305 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:18.424039 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:18.425966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:18.430887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:18.431332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:18.432088 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:18.432521 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:18.559838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:18.562002 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=73 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:18.567676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-31f88d10-778c-4e95-90fb-cf47da7ef29b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.149077 Jun 18 05:24:18.568230 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 486/980] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:18 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:19.584615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:19.585258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:19.591800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:19.592245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:19.593004 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:19.593458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:19.731732 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:19.745177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a43c295b-15ad-43ad-85a9-cb04d125a31e tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.164410 Jun 18 05:24:19.745807 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 495/981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:19 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:20.762176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:20.762781 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:20.768879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:20.769327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:20.770106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:20.770742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:20.903850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:20.912313 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0dc95bae-2e3e-4978-a507-ad29e5f07d6b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.154298 Jun 18 05:24:20.912816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 487/982] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:20 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:21.929572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:21.930252 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:21.932729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:21.937647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:21.938093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:21.938855 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:21.939290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:22.071387 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:22.078827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-499ec2f7-e250-4b70-b56d-f7623d1f576a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.153824 Jun 18 05:24:22.079388 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 496/983] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:21 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:24:23.095942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:23.096607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:23.098408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:23.099188 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:23.105014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.105499 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.106269 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.106707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.276423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:23.276920 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:23.283720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.284166 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.284942 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.285375 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.292717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:23.300562 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e8d93caf-3a99-463f-81ea-2d88a6a41ecf tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.208454 Jun 18 05:24:23.301471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 488/984] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:23 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:23.307115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-48e5f4af-f3ac-435c-b535-622acd9dcc42 req-c5f8129e-886d-48f8-b458-32253cdd77f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:23.315059 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:24:23.316339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-48e5f4af-f3ac-435c-b535-622acd9dcc42 req-c5f8129e-886d-48f8-b458-32253cdd77f8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.316874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-48e5f4af-f3ac-435c-b535-622acd9dcc42 req-c5f8129e-886d-48f8-b458-32253cdd77f8 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.329243 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-48e5f4af-f3ac-435c-b535-622acd9dcc42 req-c5f8129e-886d-48f8-b458-32253cdd77f8 service nova] Creating event network-changed:2e6ea935-169b-426c-bf26-11d644b1d476 for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b on hv-cinder-83699 Jun 18 05:24:23.336489 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-48e5f4af-f3ac-435c-b535-622acd9dcc42 req-c5f8129e-886d-48f8-b458-32253cdd77f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Jun 18 05:24:23.340116 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 489/985] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:23.578888 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-44fb95fb-50c1-435d-b780-dddecb88e5e8 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 204 len: 0 microversion: 2.1 time: 0.307767 Jun 18 05:24:23.580108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 497/986] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:24:23 2022] DELETE /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:24:23.588893 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:23.589632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:23.595838 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.596291 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.597061 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:23.597522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:23.734316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:23.742681 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-10e1e773-ae49-41bf-bb60-f924cd4e6107 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.158093 Jun 18 05:24:23.743572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 490/987] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:23 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:24.002163 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-27ac9131-cdd7-49d6-ad90-e7d51a40a69c req-4e14952c-3175-443e-b7dd-7484494c9249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f110a7a4-de6a-4986-b264-d09af210aaa7", "name": "network-vif-plugged", "status": "completed", "tag": "f108c405-22fa-4032-b9a5-fc33f14813ab"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:24.011043 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-27ac9131-cdd7-49d6-ad90-e7d51a40a69c req-4e14952c-3175-443e-b7dd-7484494c9249 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:24.011490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-27ac9131-cdd7-49d6-ad90-e7d51a40a69c req-4e14952c-3175-443e-b7dd-7484494c9249 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:24.023314 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-27ac9131-cdd7-49d6-ad90-e7d51a40a69c req-4e14952c-3175-443e-b7dd-7484494c9249 service nova] Creating event network-vif-plugged:f108c405-22fa-4032-b9a5-fc33f14813ab for instance f110a7a4-de6a-4986-b264-d09af210aaa7 on hv-cinder-83699 Jun 18 05:24:24.028454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-27ac9131-cdd7-49d6-ad90-e7d51a40a69c req-4e14952c-3175-443e-b7dd-7484494c9249 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Jun 18 05:24:24.029342 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 498/988] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:24.317954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:24.319282 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:24.326136 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:24.326579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:24.327348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:24.327780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:24.459484 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:24.466842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-aee9f128-584a-4d63-9107-b37bc43ff631 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.152826 Jun 18 05:24:24.467401 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 491/989] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:24 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:24.760976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:24.761712 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:24.768566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:24.769016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:24.769812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:24.770250 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:24.907667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:24.915420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-50801d44-138f-45d2-b173-2fe2d4ed1d2a tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.158637 Jun 18 05:24:24.916079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 499/990] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:24 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:25.483182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:25.483792 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:25.490272 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:25.490719 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:25.491476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:25.492432 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:25.654921 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:25.662903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1bc658cd-147f-4163-9ab2-f0f9e54e9aff tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1318 microversion: 2.1 time: 0.183635 Jun 18 05:24:25.663473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 492/991] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:25 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:25.933414 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:25.934036 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:25.936413 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:25.941131 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:25.941611 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:25.942366 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:25.942795 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:26.076891 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:26.084461 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e482c942-def5-4e49-9690-c4e7ed4b1bc1 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1568 microversion: 2.1 time: 0.155539 Jun 18 05:24:26.088079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 500/992] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:25 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:26.500099 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-0e0d7e64-609f-44a8-990b-a609d8576c47 req-88748a99-04c9-4130-b8a2-1dda7af8e1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b", "name": "network-vif-deleted", "tag": "2e6ea935-169b-426c-bf26-11d644b1d476"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:26.508737 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-0e0d7e64-609f-44a8-990b-a609d8576c47 req-88748a99-04c9-4130-b8a2-1dda7af8e1a6 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:26.509182 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-0e0d7e64-609f-44a8-990b-a609d8576c47 req-88748a99-04c9-4130-b8a2-1dda7af8e1a6 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:26.519905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-0e0d7e64-609f-44a8-990b-a609d8576c47 req-88748a99-04c9-4130-b8a2-1dda7af8e1a6 service nova] Creating event network-vif-deleted:2e6ea935-169b-426c-bf26-11d644b1d476 for instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b on hv-cinder-83699 Jun 18 05:24:26.524699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-0e0d7e64-609f-44a8-990b-a609d8576c47 req-88748a99-04c9-4130-b8a2-1dda7af8e1a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028304 Jun 18 05:24:26.525266 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 493/993] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:26.678755 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:26.680427 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:26.686405 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:26.686829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:26.687580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:26.688010 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:26.825658 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:26.833577 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-be8073b0-17ab-4a0e-822c-ebad3634a01a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1506 microversion: 2.1 time: 0.158639 Jun 18 05:24:26.834192 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 501/994] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:26 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:27.108825 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:27.109551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:27.115922 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:27.116382 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:27.117151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:27.117764 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:27.183667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:27.191828 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-831e5dd3-f128-466b-8877-751c43f7914e tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1220 microversion: 2.1 time: 0.087223 Jun 18 05:24:27.192408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 494/995] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:27 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:24:28.210319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:28.211610 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:28.218300 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:28.218772 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:28.219717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:28.220085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:28.253520 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:28.253969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:28.254647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lazy-loading 'fault' on Instance uuid d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:24:28.301343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc735165cd4029bd5d581fd0187f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a7c712ebe34d53b4acd7e8473c6d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:24:28.310211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-80484a69-6d32-4ac0-91d5-a26b3eb490c7 tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 200 len: 1225 microversion: 2.1 time: 0.104172 Jun 18 05:24:28.310844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 502/996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:28 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:24:29.328479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:29.329086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] [instance: d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:29.336694 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:29.337143 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:29.337943 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:29.338376 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:29.352915 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] HTTP exception thrown: Instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b could not be found. Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Request method failure captured: Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b HTTP/1.1 Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWAi9D1WO21kUdnCZTCho5l2fi8jfbmFa2ETEumfPrZ-4DyvVeHbpxl4Ki20FCi-7BN2h08BnDRrHugi8DvKTP7gKKRa9hr9fegWjJ6zA3Pu7MLPVyF_Y11MePAkf1k588HiSJhFKIac9nIShnM6jAp0A8HibAhwAwIeaamCXbGEbyQ Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 65a7c712ebe34d53b4acd7e8473c6d95 Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-TestShelveInstance-245137814 Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:24:29.355225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a7c712ebe34d53b4acd7e8473c6d95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a7c712ebe34d53b4acd7e8473c6d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a7c712ebe34d53b4acd7e8473c6d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a7c712ebe34d53b4acd7e8473c6d95"}]}] Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-TestShelveInstance-245137814 Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 65a7c712ebe34d53b4acd7e8473c6d95 Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-TestShelveInstance-245137814 Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-TestShelveInstance-245137814-project Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 55bc735165cd4029bd5d581fd0187f9b Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-TestShelveInstance-245137814-project Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b could not be found. Jun 18 05:24:29.356885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'd0554d10-2a83-478b-a2a6-7c4bcc0dfc2b'} Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b could not be found. Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:24:29.357948 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b could not be found. Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b could not be found. Jun 18 05:24:29.359621 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:24:29.361004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Returning 404 to user: Instance d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:24:29.361004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fcbe20a6-b229-4ca5-9466-6b27bf7b831d tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b" status: 404 len: 111 microversion: 2.1 time: 0.032459 Jun 18 05:24:29.361004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 495/997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:24:29 2022] GET /compute/v2.1/servers/d0554d10-2a83-478b-a2a6-7c4bcc0dfc2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:24:29.584126 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3899ee98-5986-4bd1-ab74-230c144e2d0b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] Calling method '.version_select at 0x7f7b05f70ee0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:29.662958 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3899ee98-5986-4bd1-ab74-230c144e2d0b tempest-TestShelveInstance-245137814 tempest-TestShelveInstance-245137814-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069479018" status: 202 len: 0 microversion: 2.1 time: 0.085281 Jun 18 05:24:29.663589 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 503/998] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Jun 18 05:24:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069479018 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:24:49.710193 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "febdc405-f83a-4c9b-9409-de9827540a04", "device": "/dev/sdb"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:24:49.711792 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:49.724132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=19 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:49.724132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=43 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:49.724132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:49.724132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:49.724132 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:49.724646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:50.444190 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fb7e7b46-5888-4b23-a091-0122ed344f9f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "POST /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737402 Jun 18 05:24:50.444793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 496/999] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:24:49 2022] POST /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:24:59.144002 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:24:59.144554 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:24:59.147914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:59.148558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:24:59.153259 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:59.155260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:59.155260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:24:59.155260 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:24:59.178805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2b901dfd-a593-4d70-9c29-28b79632ce45 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/ips" status: 200 len: 151 microversion: 2.1 time: 0.038588 Jun 18 05:24:59.183961 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 504/1000] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:24:59 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:02.988579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656da4ab-ef37-4996-9997-c1760e7e9e8f"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:02.990047 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:02.992609 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:02.993301 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:03.000214 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:03.000742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:03.001662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:03.002167 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:03.866279 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-733da55e-8671-4f32-adb8-19aae275d672 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881018 Jun 18 05:25:03.869262 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 497/1001] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:25:02 2022] POST /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:11.791193 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:25:11.791716 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Sat Jun 18 05:25:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:25:16.691199 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4b8af417-876d-4df7-a8f3-72a0edfc478e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: .version_select at 0x7f7b05ea8160>, body: {"keypair": {"name": "tempest-keypair-434781931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMD81+ckuYpMucGQLTBEUtLhCOqtXAuaB7XUHzMXDH+1oJHXTOAjFTfx3yVBNfr4RWxYdwEo0yurRl4WdVPnWHSqWardHWcEZtLD5p/LRJsLdbCUvAL4Rmh//mU5cy0bQ=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:16.707052 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-4b8af417-876d-4df7-a8f3-72a0edfc478e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:25:16.711721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-4b8af417-876d-4df7-a8f3-72a0edfc478e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:25:16.812487 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4b8af417-876d-4df7-a8f3-72a0edfc478e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125658 Jun 18 05:25:16.813015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 505/1002] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:25:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:18.590958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:18.591738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:18.596152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:18.596742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:18.603311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:18.603762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:18.604523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:18.604958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:18.688590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lazy-loading 'services' on Instance uuid f110a7a4-de6a-4986-b264-d09af210aaa7 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:25:18.907461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-3f5e51f4-3287-4638-b01c-ff8668e5618b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7/os-volume_attachments/febdc405-f83a-4c9b-9409-de9827540a04" status: 202 len: 0 microversion: 2.1 time: 0.317806 Jun 18 05:25:18.908051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 498/1003] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:25:18 2022] DELETE /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7/os-volume_attachments/febdc405-f83a-4c9b-9409-de9827540a04 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:25:19.101490 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1112314973", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c244710-1fba-414f-9d04-4fcd88e7ed14"}], "security_groups": [{"name": "tempest-securitygroup--1064025617"}], "key_name": "tempest-keypair-434781931", "user_data": "}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:19.204251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] validate_networks() for [('1c244710-1fba-414f-9d04-4fcd88e7ed14', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:25:19.679730 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:25:19.680155 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:25:19.682498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:25:19.682498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:25:19.682498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:25:19.698904 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:19.699394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:19.700189 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:19.700814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:19.718983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:25:19.723133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:25:19.734573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:25:19.737573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:25:19.877430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-70a79e92-d5cb-441c-9ba2-755f0aff78ab tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.782465 Jun 18 05:25:19.878281 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 506/1004] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:25:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 05:25:19.889756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8763156e-c804-415b-938c-616a7bf5afb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:19.890758 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8763156e-c804-415b-938c-616a7bf5afb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:19.948105 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8763156e-c804-415b-938c-616a7bf5afb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:19.955803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8763156e-c804-415b-938c-616a7bf5afb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1241 microversion: 2.1 time: 0.069481 Jun 18 05:25:19.955803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 499/1005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:19 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:20.040926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:20.041470 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:20.048982 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:20.049486 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:20.050281 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:20.050781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:20.078267 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:25:20.419218 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6a3f3d11-e076-4e5e-9a26-d56631749c63 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 204 len: 0 microversion: 2.1 time: 0.384515 Jun 18 05:25:20.420667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 507/1006] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:25:20 2022] DELETE /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:25:20.428804 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:20.430270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:20.437882 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:20.438531 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:20.439323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:20.439913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:20.642635 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:20.652573 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-31cdf937-14fb-4370-8c15-a84c8f07cdb3 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1512 microversion: 2.1 time: 0.227639 Jun 18 05:25:20.654076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 500/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:20 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:20.974288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:20.974288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:20.981430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:20.981826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:20.982899 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:20.983328 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:21.045696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:21.053343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-22dfe27a-b30e-4caa-a2dd-5ca7bb0c943a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1245 microversion: 2.1 time: 0.084982 Jun 18 05:25:21.054532 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 508/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:20 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:21.669679 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:21.670477 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:21.677014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:21.680128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:21.680128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:21.680128 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:21.814991 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:21.823255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9022b863-584f-4b10-9941-787833b4f2d6 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1512 microversion: 2.1 time: 0.157686 Jun 18 05:25:21.823822 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 501/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:21 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:22.070182 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:22.070764 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:22.080068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:22.080514 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:22.081294 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:22.081875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:22.157050 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:22.165439 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4dc396de-895c-4517-b3a2-5fc80749f016 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1245 microversion: 2.1 time: 0.099161 Jun 18 05:25:22.166010 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 509/1010] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:22 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:22.840712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:22.841332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:22.848602 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:22.849144 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:22.849962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:22.850408 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:22.888782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-eda46fcc-e032-4318-8ad4-db858e0f47ca req-6c3158e9-2a1a-4c2a-8525-a3ef2cd25c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f110a7a4-de6a-4986-b264-d09af210aaa7", "name": "network-vif-deleted", "tag": "f108c405-22fa-4032-b9a5-fc33f14813ab"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:22.897240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-eda46fcc-e032-4318-8ad4-db858e0f47ca req-6c3158e9-2a1a-4c2a-8525-a3ef2cd25c40 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:22.897794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-eda46fcc-e032-4318-8ad4-db858e0f47ca req-6c3158e9-2a1a-4c2a-8525-a3ef2cd25c40 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:22.910819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-eda46fcc-e032-4318-8ad4-db858e0f47ca req-6c3158e9-2a1a-4c2a-8525-a3ef2cd25c40 service nova] Creating event network-vif-deleted:f108c405-22fa-4032-b9a5-fc33f14813ab for instance f110a7a4-de6a-4986-b264-d09af210aaa7 on hv-cinder-83699 Jun 18 05:25:22.915751 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-eda46fcc-e032-4318-8ad4-db858e0f47ca req-6c3158e9-2a1a-4c2a-8525-a3ef2cd25c40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030693 Jun 18 05:25:22.917093 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 510/1011] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:22.920277 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:22.927834 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-f2c61b9b-06b6-4b1a-ba67-140a41952ccb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1470 microversion: 2.1 time: 0.090972 Jun 18 05:25:22.929518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 502/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:22 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1470 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:23.183256 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:23.183967 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:23.190214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:23.191028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:23.191571 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:23.192012 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:23.265737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:23.276879 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2578647c-68d7-4b1e-be94-dcf1bf33304e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1293 microversion: 2.1 time: 0.098257 Jun 18 05:25:23.277654 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 511/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:23 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:23.944406 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:23.946140 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:23.952950 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:23.959803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:23.959803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:23.959803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:24.009590 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:24.010070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:24.010524 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lazy-loading 'fault' on Instance uuid f110a7a4-de6a-4986-b264-d09af210aaa7 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:25:24.060018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:24.070332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0cf00510-e0fc-483f-abea-403013fee27b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 200 len: 1308 microversion: 2.1 time: 0.129666 Jun 18 05:25:24.071504 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 503/1014] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:23 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:24.294303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:24.295526 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:24.302075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:24.302529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:24.303369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:24.303931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:24.455431 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:24.465134 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-00aaae5f-a98e-4fb3-9288-416f14787976 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.174713 Jun 18 05:25:24.466047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 512/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:24 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:25.086835 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:25.087436 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: f110a7a4-de6a-4986-b264-d09af210aaa7] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:25.096109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:25.097355 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:25.098339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:25.098778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:25.115044 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] HTTP exception thrown: Instance f110a7a4-de6a-4986-b264-d09af210aaa7 could not be found. Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Request method failure captured: Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 HTTP/1.1 Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWF2vXXZkY-yuM3LgGCXM1IslQYCdPAdJ1F0IcyGQseZVXml0y_2ryl4Cl4E5oMlnt_dPZ9w0pQ0eWKszbJzI3ut5wdMAMJrHLDpFCl_tQtycmVGTNFk1kppneSpahJgkhthvKwFxrZa3Wm9Liv2WyxNGu7x_OmjKrCYpNbuqasZ39Y Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: d8863ced0efc4b95806761cc2d8a6f78 Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1732513961 Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:25:25.117815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8863ced0efc4b95806761cc2d8a6f78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8863ced0efc4b95806761cc2d8a6f78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8863ced0efc4b95806761cc2d8a6f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8863ced0efc4b95806761cc2d8a6f78"}]}] Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-VolumesSnapshotTestJSON-1732513961 Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: d8863ced0efc4b95806761cc2d8a6f78 Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1732513961 Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-VolumesSnapshotTestJSON-1732513961-project Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: f54c1aed6a784e40952d38784bf4ed6b Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-VolumesSnapshotTestJSON-1732513961-project Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance f110a7a4-de6a-4986-b264-d09af210aaa7 could not be found. Jun 18 05:25:25.125526 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'f110a7a4-de6a-4986-b264-d09af210aaa7'} Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f110a7a4-de6a-4986-b264-d09af210aaa7 could not be found. Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:25:25.126491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f110a7a4-de6a-4986-b264-d09af210aaa7 could not be found. Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f110a7a4-de6a-4986-b264-d09af210aaa7 could not be found. Jun 18 05:25:25.128086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:25:25.129584 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Returning 404 to user: Instance f110a7a4-de6a-4986-b264-d09af210aaa7 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:25:25.129584 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-db18fd7a-6458-46e6-88fa-9a4f864f963f tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7" status: 404 len: 111 microversion: 2.1 time: 0.036306 Jun 18 05:25:25.129584 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 504/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:25 2022] GET /compute/v2.1/servers/f110a7a4-de6a-4986-b264-d09af210aaa7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:25:25.483604 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-89feb4d8-bd04-4b22-aad6-65971a09461e req-f597bcb3-d16c-4cd2-9e34-88610ff81c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87d5fa9-8c4d-4486-8fa8-dab86dcdb126", "tag": "3143144b-5f00-4c85-b3d9-006144d97ae7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:25.486832 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:25.487447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:25.495286 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-89feb4d8-bd04-4b22-aad6-65971a09461e req-f597bcb3-d16c-4cd2-9e34-88610ff81c75 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:25.496560 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-89feb4d8-bd04-4b22-aad6-65971a09461e req-f597bcb3-d16c-4cd2-9e34-88610ff81c75 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:25.506727 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:25.507483 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:25.508307 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:25.508740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:25.513370 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-89feb4d8-bd04-4b22-aad6-65971a09461e req-f597bcb3-d16c-4cd2-9e34-88610ff81c75 service nova] Creating event network-changed:3143144b-5f00-4c85-b3d9-006144d97ae7 for instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 on hv-cinder-83699 Jun 18 05:25:25.519698 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-89feb4d8-bd04-4b22-aad6-65971a09461e req-f597bcb3-d16c-4cd2-9e34-88610ff81c75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047047 Jun 18 05:25:25.520758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 513/1017] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:26.015586 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:26.024541 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c1c7a094-5def-4961-a99e-cbf7568a8203 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.545500 Jun 18 05:25:26.025314 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 505/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:25 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:27.042937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:27.043550 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:27.050258 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:27.050715 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:27.051481 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:27.051945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:27.184255 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:27.191673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b0c1b8fc-b14e-4467-a3eb-ac343718dc44 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.153752 Jun 18 05:25:27.192240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 514/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:27 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:28.208803 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:28.209345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:28.216270 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:28.216718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:28.217507 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:28.217940 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:28.353545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:28.360911 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-17f7c396-f3c1-439e-ac64-133744bcee7d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.156062 Jun 18 05:25:28.361680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 506/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:28 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:29.377061 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:29.377686 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:29.384192 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:29.384629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:29.385389 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:29.385827 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:29.515850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:29.523436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-527f59a0-784b-4370-8a98-288f74dd3798 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.150175 Jun 18 05:25:29.523992 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 515/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:29 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:30.541068 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:30.541707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:30.545561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:30.549023 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:30.549488 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:30.550248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:30.550800 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:30.689812 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:30.702429 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c690e571-c2cf-42f9-b332-e0a81457e842 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.165306 Jun 18 05:25:30.703149 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 507/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:30 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:31.720194 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:31.722376 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:31.722829 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:31.723539 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=10 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:31.729657 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:31.730108 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:31.730881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:31.731318 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:31.890423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:31.898686 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a72f7a54-6b32-4cb5-9f42-a8dddc93ee2d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.181996 Jun 18 05:25:31.899456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 516/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:31 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:32.916111 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:32.916729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:32.923397 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:32.923851 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:32.924611 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:32.925050 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:33.064330 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:33.072559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-99cde705-cf61-4e56-8901-13841a5e33ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.160329 Jun 18 05:25:33.073118 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 508/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:32 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:33.631336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1333977672", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "networks": [{"uuid": "a7bf14ab-72b2-42a1-a57f-14612ca15e66"}]}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:33.686518 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] validate_networks() for [('a7bf14ab-72b2-42a1-a57f-14612ca15e66', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:25:34.049758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:25:34.049758 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:25:34.050137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:25:34.050533 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:25:34.050994 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:25:34.060210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:34.060648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:34.061468 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:34.061895 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:34.080055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Getting quotas for project d8863ced0efc4b95806761cc2d8a6f78. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:25:34.083977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Getting quotas for user f54c1aed6a784e40952d38784bf4ed6b and project d8863ced0efc4b95806761cc2d8a6f78. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:25:34.096164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:25:34.098436 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:25:34.099488 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:34.100108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:34.107249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:34.107249 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:34.108101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:34.108536 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:34.231142 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c97e28a2-6bd8-4c71-87d3-e90737bbf33a tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604247 Jun 18 05:25:34.237115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 517/1025] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 05:25:34.243569 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-be957696-fc37-4b9d-882c-69d9e0a02016 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:34.252937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-be957696-fc37-4b9d-882c-69d9e0a02016 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:34.253212 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:34.285722 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a5b8d816-7ce0-426a-a4f9-8359c677aca7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.190273 Jun 18 05:25:34.286317 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 509/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:34 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:34.305977 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-be957696-fc37-4b9d-882c-69d9e0a02016 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:34.314259 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-be957696-fc37-4b9d-882c-69d9e0a02016 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1219 microversion: 2.1 time: 0.075721 Jun 18 05:25:34.314682 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 518/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:34 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:35.302683 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:35.303391 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:35.310646 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:35.311094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:35.311855 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:35.312289 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:35.337319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:35.338290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:35.346015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:35.346559 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:35.347519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:35.348012 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:35.412099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:35.420895 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9ed89f88-1736-496a-83ed-8bc12e30995b tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1223 microversion: 2.1 time: 0.088119 Jun 18 05:25:35.421907 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 519/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:35 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:35.495333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:35.503131 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ebc4dc0b-3baa-454b-83f9-d022e94a3f4d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.204253 Jun 18 05:25:35.503705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 510/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:35 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:36.437832 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:36.438443 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:36.446160 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:36.446604 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:36.449091 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:36.449564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:36.520094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:36.520706 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:36.522120 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:36.527430 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:36.527813 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:36.528578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:36.529010 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:36.532601 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1bfbb81e-e2af-4bf2-9a31-292e764bbd5c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1215 microversion: 2.1 time: 0.098539 Jun 18 05:25:36.533808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 520/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:36 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:36.674953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:36.683583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-25f4cfef-15d8-4ccd-ac80-62b548395685 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.167359 Jun 18 05:25:36.684518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 511/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:36 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:37.549872 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:37.550512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:37.557519 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:37.557988 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:37.558743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:37.559174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:37.642109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:37.651364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1d1350c8-3b45-4b97-989a-4d2ed62dcab7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1289 microversion: 2.1 time: 0.105257 Jun 18 05:25:37.661142 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 521/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:37 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:37.701703 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:37.702393 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:37.712255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:37.712255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:37.712587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:37.713059 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:37.949579 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:37.956980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6931ebb7-8e90-4832-9ce8-e6bb40c5b3e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.259239 Jun 18 05:25:37.957568 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 512/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:37 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:38.439635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-09be592c-7293-4cb5-8737-0ca6109bee35 req-312d575d-4329-445f-8ddb-69bf19b940f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87d5fa9-8c4d-4486-8fa8-dab86dcdb126", "name": "network-vif-plugged", "status": "completed", "tag": "3143144b-5f00-4c85-b3d9-006144d97ae7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:38.451702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-09be592c-7293-4cb5-8737-0ca6109bee35 req-312d575d-4329-445f-8ddb-69bf19b940f9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:38.452615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-09be592c-7293-4cb5-8737-0ca6109bee35 req-312d575d-4329-445f-8ddb-69bf19b940f9 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:38.467217 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-09be592c-7293-4cb5-8737-0ca6109bee35 req-312d575d-4329-445f-8ddb-69bf19b940f9 service nova] Creating event network-vif-plugged:3143144b-5f00-4c85-b3d9-006144d97ae7 for instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 on hv-cinder-83699 Jun 18 05:25:38.472206 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-09be592c-7293-4cb5-8737-0ca6109bee35 req-312d575d-4329-445f-8ddb-69bf19b940f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037019 Jun 18 05:25:38.472794 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 522/1034] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:38.668990 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:38.670174 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:38.676947 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:38.679608 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:38.679608 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:38.679608 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:38.930780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:38.939632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4e25edf4-ad60-4bea-9542-4c054f7b9dbd tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.275157 Jun 18 05:25:38.940446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 513/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:38 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:38.978582 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:38.979498 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:38.987028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:38.987489 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:38.988277 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:38.989098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:39.132579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:39.141713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e567f2d0-0c8b-4691-9c60-6aed533a7a85 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.169168 Jun 18 05:25:39.141713 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 523/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:38 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:39.212138 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-8082dca5-fec5-4971-aa2f-0b587541cc28 req-d446a87c-ace1-468e-b022-6980b512f1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988490dd-03b8-4f3b-ac01-191d7e3f5985", "tag": "98cb0377-90ac-4b5c-87c1-a5c2b4d539a0"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:39.220347 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8082dca5-fec5-4971-aa2f-0b587541cc28 req-d446a87c-ace1-468e-b022-6980b512f1d7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:39.220792 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-8082dca5-fec5-4971-aa2f-0b587541cc28 req-d446a87c-ace1-468e-b022-6980b512f1d7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:39.232628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-8082dca5-fec5-4971-aa2f-0b587541cc28 req-d446a87c-ace1-468e-b022-6980b512f1d7 service nova] Creating event network-changed:98cb0377-90ac-4b5c-87c1-a5c2b4d539a0 for instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 on hv-cinder-83699 Jun 18 05:25:39.238448 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-8082dca5-fec5-4971-aa2f-0b587541cc28 req-d446a87c-ace1-468e-b022-6980b512f1d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030963 Jun 18 05:25:39.243675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 514/1037] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:39.956780 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:39.957404 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:39.964747 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:39.968150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:39.968150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:39.968150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:39.985087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:40.102825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:40.117637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-01d7e895-3164-4f30-b6d5-a5816dbe7359 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.157784 Jun 18 05:25:40.117637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 524/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:39 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:40.158632 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:40.159340 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:40.166228 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:40.166680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:40.167443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:40.167879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:40.305470 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:40.309326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:40.313906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6fadcd6d-a289-4693-9507-7e99714ac1e1 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1367 microversion: 2.1 time: 0.159748 Jun 18 05:25:40.314476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 515/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:40 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:41.053696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-364965558", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-330640060", "security_groups": [{"name": "tempest-secgroup-smoke-1088067478"}], "block_device_mapping_v2": [{"uuid": "241f6ff9-7dbe-418e-9ff0-66c8d9cfcc5a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1df631c6-dcd7-4307-8f3b-f75e299e78ec"}]}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:41.128895 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:41.129927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:41.136852 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.137583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.138462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.139171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.167100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] validate_networks() for [('1df631c6-dcd7-4307-8f3b-f75e299e78ec', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:25:41.273906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:41.282428 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-564e9e12-5bbb-46ca-ac69-9868234ff241 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.158283 Jun 18 05:25:41.283053 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 516/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:41 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:41.331041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:41.331652 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:41.338528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.338972 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.339736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.340165 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.507414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:41.514470 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b3f855dc-e3bc-477a-b9e0-92415815c003 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1557 microversion: 2.1 time: 0.187176 Jun 18 05:25:41.515066 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 517/1041] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:41 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1557 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:41.532375 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:41.533637 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:41.541744 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.542514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.546083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.546083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.640127 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-73b401a5-7805-44cc-8aeb-b448b7922f86 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112373 Jun 18 05:25:41.640762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 518/1042] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:25:41 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:25:41.855558 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:25:41.856056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:25:41.856648 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:25:41.857174 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:25:41.857683 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:25:41.867364 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.867891 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.868836 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:41.869350 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:41.887349 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:25:41.889763 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:41.892161 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Getting quotas for user 6d24c8fbdc7246e2af87004f2985a9f5 and project e5e4aece32ff462b9b9a42200d584c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:25:41.953228 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:25:41.955336 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='241f6ff9-7dbe-418e-9ff0-66c8d9cfcc5a',volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:25:42.301189 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:42.302571 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:42.309120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:42.309980 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:42.311317 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:42.311976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:42.475355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2e149ed1-c0fb-485d-823b-8a3d62f56ba3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.425486 Jun 18 05:25:42.478981 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 525/1043] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:25:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:25:42.489112 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1ed92a6e-de38-42f0-9746-dd9eee400e33 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:42.490270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1ed92a6e-de38-42f0-9746-dd9eee400e33 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:42.571946 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-1ed92a6e-de38-42f0-9746-dd9eee400e33 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:42.580820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1ed92a6e-de38-42f0-9746-dd9eee400e33 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1093 microversion: 2.1 time: 0.096267 Jun 18 05:25:42.582330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 526/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:42 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:42.619670 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:42.628003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4b658b02-090a-41e0-985a-b9a23e600199 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.331574 Jun 18 05:25:42.628726 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 519/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:42 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:42.846987 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-2e581345-7c07-416f-b35d-59d4b80cd65e req-85ec14cd-f099-4a2b-a3f6-8d26bcf7ad0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87d5fa9-8c4d-4486-8fa8-dab86dcdb126", "tag": "3143144b-5f00-4c85-b3d9-006144d97ae7"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:42.855809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-2e581345-7c07-416f-b35d-59d4b80cd65e req-85ec14cd-f099-4a2b-a3f6-8d26bcf7ad0d service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:42.856257 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-2e581345-7c07-416f-b35d-59d4b80cd65e req-85ec14cd-f099-4a2b-a3f6-8d26bcf7ad0d service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:42.867646 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-2e581345-7c07-416f-b35d-59d4b80cd65e req-85ec14cd-f099-4a2b-a3f6-8d26bcf7ad0d service nova] Creating event network-changed:3143144b-5f00-4c85-b3d9-006144d97ae7 for instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 on hv-cinder-83699 Jun 18 05:25:42.873006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-2e581345-7c07-416f-b35d-59d4b80cd65e req-85ec14cd-f099-4a2b-a3f6-8d26bcf7ad0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029854 Jun 18 05:25:42.873637 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 527/1046] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:43.607175 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:43.607732 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:43.615114 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:43.615565 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:43.616984 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:43.617442 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:43.647960 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:43.649785 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:43.657416 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:43.658126 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:43.659191 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:43.659886 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:43.687614 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:43.695528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-49496edb-f001-4d62-8659-73c9221492db tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1143 microversion: 2.1 time: 0.092254 Jun 18 05:25:43.696204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 520/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:43 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:43.800800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:43.809051 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-41f13a0c-9e47-4c52-9cef-229bcbf02009 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.165821 Jun 18 05:25:43.810139 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 528/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:43 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:44.718462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:44.718462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:44.723343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:44.723987 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:44.725077 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:44.725747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:44.813586 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:44.829547 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:44.833760 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:44.846445 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9fd40687-4832-439a-8de3-da4d73c55cf8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1209 microversion: 2.1 time: 0.136753 Jun 18 05:25:44.848083 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 521/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:44 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1209 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:44.849474 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:44.850123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:44.851076 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:44.851699 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:45.051220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:45.065571 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-285ebad0-2f67-4ec9-b656-dd498cfffea4 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.235822 Jun 18 05:25:45.065571 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 529/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:44 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:45.868638 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:45.869268 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:45.876102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:45.876548 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:45.879457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:45.879457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:46.076915 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:46.077553 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:46.084006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:46.084447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:46.085154 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:46.085327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:46.085669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:46.093939 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e05b4631-eb1f-4055-9870-4ba013be2c18 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1277 microversion: 2.1 time: 0.230772 Jun 18 05:25:46.094753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 522/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:45 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:46.219117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:46.229154 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ae3df802-53b5-4a1b-a742-622b7b19a79c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.155790 Jun 18 05:25:46.229776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 530/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:46 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:46.421350 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-3210e1f4-3753-4bf2-9107-34ee8bda6e6f req-4fc4c2ec-dd1a-4e7e-a155-f1fe42667c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988490dd-03b8-4f3b-ac01-191d7e3f5985", "name": "network-vif-plugged", "status": "completed", "tag": "98cb0377-90ac-4b5c-87c1-a5c2b4d539a0"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:46.429691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-3210e1f4-3753-4bf2-9107-34ee8bda6e6f req-4fc4c2ec-dd1a-4e7e-a155-f1fe42667c9e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:46.430271 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-3210e1f4-3753-4bf2-9107-34ee8bda6e6f req-4fc4c2ec-dd1a-4e7e-a155-f1fe42667c9e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:46.441281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-3210e1f4-3753-4bf2-9107-34ee8bda6e6f req-4fc4c2ec-dd1a-4e7e-a155-f1fe42667c9e service nova] Creating event network-vif-plugged:98cb0377-90ac-4b5c-87c1-a5c2b4d539a0 for instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 on hv-cinder-83699 Jun 18 05:25:46.446960 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-3210e1f4-3753-4bf2-9107-34ee8bda6e6f req-4fc4c2ec-dd1a-4e7e-a155-f1fe42667c9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029101 Jun 18 05:25:46.450242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 523/1053] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:46.522614 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-a542acb8-c810-42b4-848a-d2107972a5fc req-5963bd56-168c-4203-ac58-78fffc163762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6e312a-e89e-46b8-8651-d8af33b96e1b", "tag": "30ebdd42-475a-47af-a0f7-18a2a06c0df9"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:46.547957 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-a542acb8-c810-42b4-848a-d2107972a5fc req-5963bd56-168c-4203-ac58-78fffc163762 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:46.551327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-a542acb8-c810-42b4-848a-d2107972a5fc req-5963bd56-168c-4203-ac58-78fffc163762 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:46.567504 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-a542acb8-c810-42b4-848a-d2107972a5fc req-5963bd56-168c-4203-ac58-78fffc163762 service nova] Creating event network-changed:30ebdd42-475a-47af-a0f7-18a2a06c0df9 for instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b on hv-cinder-83699 Jun 18 05:25:46.573226 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-a542acb8-c810-42b4-848a-d2107972a5fc req-5963bd56-168c-4203-ac58-78fffc163762 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056308 Jun 18 05:25:46.573876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 531/1054] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:47.113060 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:47.113811 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:47.120194 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:47.120641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:47.121431 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:47.121874 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:47.248003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:47.248729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:47.254951 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:47.255407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:47.256150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:47.256579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:47.261074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:47.268528 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b86d2266-55e2-4ed7-8f4e-d52afa1fa0c9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.160233 Jun 18 05:25:47.269103 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 524/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:47 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:47.387865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:47.395453 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-0623f8aa-5f63-4eef-afb9-fce89ba8dedb tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1319 microversion: 2.1 time: 0.152732 Jun 18 05:25:47.396035 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 532/1056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:47 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:48.286656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:48.287201 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:48.294558 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:48.295013 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:48.295766 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:48.296199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:48.412379 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:48.412983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:48.420115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:48.420556 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:48.421327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:48.421782 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:48.488432 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:48.496325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-72c6e362-b45c-4f8f-9fcc-cbd205878505 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.213560 Jun 18 05:25:48.496981 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 525/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:48 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:48.552475 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:48.560074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ae78e221-320c-41c6-8c11-62134e78e3d7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1507 microversion: 2.1 time: 0.151567 Jun 18 05:25:48.560638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 533/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:48 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:25:48.576617 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfeb43c3-f431-4d7f-b720-5e5298a84321", "device": "/dev/sdb"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:48.577740 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:48.583724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:48.584166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:48.584913 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:48.585340 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:49.431787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b8f88417-88ed-49d6-bc47-26be4e495a13 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "POST /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859015 Jun 18 05:25:49.432407 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 526/1059] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:25:48 2022] POST /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:25:49.513360 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:49.514006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:49.520395 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:49.520875 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:49.521665 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:49.522102 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:49.657592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:49.665937 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7062d97e-2ca0-41a0-94fd-a6beff0ed432 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.156222 Jun 18 05:25:49.666617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 534/1060] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:49 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:50.684170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:50.684864 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:50.686891 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=63 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:50.691839 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:50.692281 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:50.693031 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:50.693488 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:50.828642 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:50.836226 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-ae4e55aa-b1e2-4dba-bac0-f9403406c4f0 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.157641 Jun 18 05:25:50.836793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 527/1061] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:50 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:51.853180 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:51.853811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:51.860472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:51.860922 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:51.861719 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:51.862157 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:51.876717 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:51.992420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:52.001019 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e78ae57d-04c8-4b78-9023-14ffc0832c47 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.151652 Jun 18 05:25:52.001785 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 535/1062] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:51 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:53.017799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:53.018462 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:53.025157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:53.025662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:53.027094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:53.027530 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:53.156875 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:53.164575 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d41f08e3-24ed-46d1-ba80-2949afbeb225 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.150666 Jun 18 05:25:53.165139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 528/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:53 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:54.181625 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:54.182237 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:54.184659 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=16 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:25:54.190128 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:54.191867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:54.191867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:54.191867 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:54.324322 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:54.331655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e5756de8-67bd-4476-ac22-97fd8414c615 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.153898 Jun 18 05:25:54.332548 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 536/1064] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:54 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:55.347856 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:55.348465 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:55.355735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:55.356179 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:55.356940 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:55.357370 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:55.487920 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:55.495386 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-53f08d5a-8a81-42ea-a0d6-bfe07b2d208f tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.151386 Jun 18 05:25:55.496093 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 529/1065] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:55 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:56.512133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:56.512753 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:56.519628 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:56.520075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:56.520840 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:56.521279 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:56.654601 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:56.662621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7f0f133b-fe74-4426-9df4-733bce38a5f3 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.154472 Jun 18 05:25:56.663183 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 537/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:56 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:57.679745 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:57.680356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:57.687015 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:57.687463 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:57.688230 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:57.688666 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:57.815443 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:57.822799 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d76dc7b1-c119-4abd-8fed-b09ad62f2dbf tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.146961 Jun 18 05:25:57.823359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 530/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:57 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:25:58.468308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-9d54da56-cbda-4472-ae19-1a336563f31c req-f6218aaa-d311-452e-93a0-6e9c6550ec4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e312a-e89e-46b8-8651-d8af33b96e1b", "name": "network-vif-plugged", "status": "completed", "tag": "30ebdd42-475a-47af-a0f7-18a2a06c0df9"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:25:58.476815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9d54da56-cbda-4472-ae19-1a336563f31c req-f6218aaa-d311-452e-93a0-6e9c6550ec4e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:58.477254 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9d54da56-cbda-4472-ae19-1a336563f31c req-f6218aaa-d311-452e-93a0-6e9c6550ec4e service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:58.489020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-9d54da56-cbda-4472-ae19-1a336563f31c req-f6218aaa-d311-452e-93a0-6e9c6550ec4e service nova] Creating event network-vif-plugged:30ebdd42-475a-47af-a0f7-18a2a06c0df9 for instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b on hv-cinder-83699 Jun 18 05:25:58.493969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-9d54da56-cbda-4472-ae19-1a336563f31c req-f6218aaa-d311-452e-93a0-6e9c6550ec4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029476 Jun 18 05:25:58.494550 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 538/1068] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:25:58.840628 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:25:58.841151 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:25:58.847750 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:58.848191 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:58.848942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:25:58.849371 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:25:58.979165 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:25:58.987409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4c9b30b0-79c3-4ff6-9360-f13b6223d0b9 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.151426 Jun 18 05:25:58.987973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 531/1069] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:58 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:00.005410 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:00.006126 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:00.012608 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:00.013054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:00.013863 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:00.014308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:00.141787 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:00.149129 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2a3b1c46-e170-483a-ae6b-e7ca9823f062 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.148476 Jun 18 05:26:00.149712 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 539/1070] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:25:59 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:01.166152 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:01.166775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:01.174122 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:01.174561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:01.175315 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:01.175741 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:01.179814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:01.312807 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:01.320258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bd7b29cc-13b1-4681-9ac3-e5e5dfc885f4 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.157996 Jun 18 05:26:01.320820 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 532/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:01 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:02.337363 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:02.338054 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:02.345507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:02.345964 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:02.346734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:02.347296 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:02.486781 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:02.495046 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c889bc1f-3680-4506-b883-227445f4f10e tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.161503 Jun 18 05:26:02.496171 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 540/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:02 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:26:03.512934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:03.513587 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:03.520455 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:03.520907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:03.521695 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:03.522130 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:03.655686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:03.663356 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8ef4ea2c-b363-4fd6-8cbe-668159de3569 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.154764 Jun 18 05:26:03.663927 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 533/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:03 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:04.680020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:04.680668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:04.688147 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:04.688617 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:04.689482 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:04.689919 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:04.830008 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:04.837358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8b7f672a-ee1e-445b-ad90-d028cd896893 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.161227 Jun 18 05:26:04.838004 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 541/1074] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:04 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:05.854460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:05.855074 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:05.862070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:05.862518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:05.863276 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:05.863708 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:05.995212 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:06.003811 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8dc9bc40-b2c8-450f-931e-3c69fb2d6ca6 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1265 microversion: 2.1 time: 0.153146 Jun 18 05:26:06.004662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 534/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:05 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:07.029729 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:07.030299 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:07.037355 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:07.042369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:07.042369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:07.042369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:07.183499 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:07.191843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6dc945ac-b259-4180-92df-5eec9055f839 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1453 microversion: 2.1 time: 0.166543 Jun 18 05:26:07.192412 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 542/1076] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:07 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:07.210337 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:07.210963 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:07.217134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:07.217691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:07.218459 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:07.218894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:07.353941 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:07.362137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-377d45ba-c2ec-4167-920f-b6344934d25a tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1453 microversion: 2.1 time: 0.155745 Jun 18 05:26:07.362704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 535/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:07 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:09.326742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-79c8caf3-2351-4c8c-b2de-a6dd856bc78e req-8cb8f088-3342-48f1-8772-128dfb36ed93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6e312a-e89e-46b8-8651-d8af33b96e1b", "tag": "30ebdd42-475a-47af-a0f7-18a2a06c0df9"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:09.335566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-79c8caf3-2351-4c8c-b2de-a6dd856bc78e req-8cb8f088-3342-48f1-8772-128dfb36ed93 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:09.336012 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-79c8caf3-2351-4c8c-b2de-a6dd856bc78e req-8cb8f088-3342-48f1-8772-128dfb36ed93 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:09.347660 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-79c8caf3-2351-4c8c-b2de-a6dd856bc78e req-8cb8f088-3342-48f1-8772-128dfb36ed93 service nova] Creating event network-changed:30ebdd42-475a-47af-a0f7-18a2a06c0df9 for instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b on hv-cinder-83699 Jun 18 05:26:09.352774 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-79c8caf3-2351-4c8c-b2de-a6dd856bc78e req-8cb8f088-3342-48f1-8772-128dfb36ed93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030047 Jun 18 05:26:09.353368 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 543/1078] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:10.300885 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:10.301452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:10.308292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:10.308736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:10.309546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:10.310063 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:10.391498 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lazy-loading 'services' on Instance uuid 988490dd-03b8-4f3b-ac01-191d7e3f5985 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:26:10.562798 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-96957513-1f4e-4c62-bbff-8f827e503c9c tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985/os-volume_attachments/dfeb43c3-f431-4d7f-b720-5e5298a84321" status: 202 len: 0 microversion: 2.1 time: 0.265890 Jun 18 05:26:10.563377 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 536/1079] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:26:10 2022] DELETE /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985/os-volume_attachments/dfeb43c3-f431-4d7f-b720-5e5298a84321 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:26:12.727650 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:12.728238 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:12.730238 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:12.735304 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:12.735755 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:12.736566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:12.737006 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:12.740991 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=91 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:12.764432 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:26:13.083178 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-00aa7862-39f6-493c-8ef3-ea4ffeaa90f7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 204 len: 0 microversion: 2.1 time: 0.359963 Jun 18 05:26:13.083754 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 544/1080] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:26:12 2022] DELETE /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:26:13.093127 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:13.094989 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:13.100473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:13.100924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:13.101724 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:13.102165 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:13.234843 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:13.242232 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5e75eb41-58c5-404f-a759-d679192da820 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1513 microversion: 2.1 time: 0.153960 Jun 18 05:26:13.242774 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 537/1081] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:13 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:14.260142 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:14.260831 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:14.267512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:14.267962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:14.268718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:14.269169 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:14.398221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:14.406138 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d9bfaae1-e45c-4e2b-a1ca-5520317fab7d tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1513 microversion: 2.1 time: 0.150203 Jun 18 05:26:14.407066 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 545/1082] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:14 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:15.423566 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:15.424176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:15.431465 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:15.431914 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:15.432690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:15.433121 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:15.716343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:15.724554 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-89024f20-7c74-4d84-a363-ed64a652e6ea tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1513 microversion: 2.1 time: 0.304868 Jun 18 05:26:15.725129 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 538/1083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:15 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:15.935811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-c61bd259-d2ea-4255-9a32-08839e04a3df req-a6d0209b-b8dd-4bc7-bac4-1e6df2030fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988490dd-03b8-4f3b-ac01-191d7e3f5985", "name": "network-vif-deleted", "tag": "98cb0377-90ac-4b5c-87c1-a5c2b4d539a0"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:15.944852 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c61bd259-d2ea-4255-9a32-08839e04a3df req-a6d0209b-b8dd-4bc7-bac4-1e6df2030fe5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:15.948460 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c61bd259-d2ea-4255-9a32-08839e04a3df req-a6d0209b-b8dd-4bc7-bac4-1e6df2030fe5 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:15.956703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-c61bd259-d2ea-4255-9a32-08839e04a3df req-a6d0209b-b8dd-4bc7-bac4-1e6df2030fe5 service nova] Creating event network-vif-deleted:98cb0377-90ac-4b5c-87c1-a5c2b4d539a0 for instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 on hv-cinder-83699 Jun 18 05:26:15.961530 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-c61bd259-d2ea-4255-9a32-08839e04a3df req-a6d0209b-b8dd-4bc7-bac4-1e6df2030fe5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029328 Jun 18 05:26:15.962100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 546/1084] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:16.741964 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:16.742598 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:16.748967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:16.749561 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:16.750319 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:16.750870 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:16.780988 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:16.781780 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:16.782220 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lazy-loading 'fault' on Instance uuid 988490dd-03b8-4f3b-ac01-191d7e3f5985 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:26:16.823400 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c1aed6a784e40952d38784bf4ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8863ced0efc4b95806761cc2d8a6f78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:16.830878 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-daabd4cc-5708-4ddb-88e9-ec11e86fe0e7 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 200 len: 1309 microversion: 2.1 time: 0.092651 Jun 18 05:26:16.831452 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 539/1085] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:16 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:17.851203 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:17.851896 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] [instance: 988490dd-03b8-4f3b-ac01-191d7e3f5985] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:17.858148 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:17.858619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:17.859377 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:17.859809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:17.872806 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] HTTP exception thrown: Instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 could not be found. Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Request method failure captured: Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 HTTP/1.1 Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWF2vXXZkY-yuM3LgGCXM1IslQYCdPAdJ1F0IcyGQseZVXml0y_2ryl4Cl4E5oMlnt_dPZ9w0pQ0eWKszbJzI3ut5wdMAMJrHLDpFCl_tQtycmVGTNFk1kppneSpahJgkhthvKwFxrZa3Wm9Liv2WyxNGu7x_OmjKrCYpNbuqasZ39Y Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: d8863ced0efc4b95806761cc2d8a6f78 Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1732513961 Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:26:17.874467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8863ced0efc4b95806761cc2d8a6f78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8863ced0efc4b95806761cc2d8a6f78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8863ced0efc4b95806761cc2d8a6f78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8863ced0efc4b95806761cc2d8a6f78"}]}] Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesSnapshotTestJSON-1732513961 Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: d8863ced0efc4b95806761cc2d8a6f78 Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1732513961 Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesSnapshotTestJSON-1732513961-project Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: f54c1aed6a784e40952d38784bf4ed6b Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesSnapshotTestJSON-1732513961-project Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 could not be found. Jun 18 05:26:17.876095 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '988490dd-03b8-4f3b-ac01-191d7e3f5985'} Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 could not be found. Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:26:17.876897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 could not be found. Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 could not be found. Jun 18 05:26:17.878613 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:17.880100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] Returning 404 to user: Instance 988490dd-03b8-4f3b-ac01-191d7e3f5985 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:26:17.880100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bd27ea3f-49a1-4077-93a4-af8d4f531317 tempest-VolumesSnapshotTestJSON-1732513961 tempest-VolumesSnapshotTestJSON-1732513961-project] 10.222.0.23 "GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985" status: 404 len: 111 microversion: 2.1 time: 0.029382 Jun 18 05:26:17.880100 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 547/1086] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:17 2022] GET /compute/v2.1/servers/988490dd-03b8-4f3b-ac01-191d7e3f5985 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:26:26.503034 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:26.503615 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:26.505664 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=28 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:26.510372 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.510823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.511580 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.512012 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.535507 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-962e762b-c22d-436e-ab45-2be7bf5ec07a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/ips" status: 200 len: 150 microversion: 2.1 time: 0.036656 Jun 18 05:26:26.536076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 540/1087] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:26:26 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:26.546362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656da4ab-ef37-4996-9997-c1760e7e9e8f"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:26.547426 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:26.554876 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.555321 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.556078 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.556510 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.633472 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Invalid volume: volume 656da4ab-ef37-4996-9997-c1760e7e9e8f is already attached to instances: 589899a5-db4e-4c26-9411-811a83bd6f35 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: POST /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/os-volume_attachments HTTP/1.1 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 74 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:26:26.635087 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {"volumeAttachment": {"volumeId": "656da4ab-ef37-4996-9997-c1760e7e9e8f"}} Jun 18 05:26:26.636720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Invalid volume: volume 656da4ab-ef37-4996-9997-c1760e7e9e8f is already attached to instances: 589899a5-db4e-4c26-9411-811a83bd6f35 Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'server_id': 'c87d5fa9-8c4d-4486-8fa8-dab86dcdb126', 'body': {'volumeAttachment': {'volumeId': '656da4ab-ef37-4996-9997-c1760e7e9e8f'}}} Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 656da4ab-ef37-4996-9997-c1760e7e9e8f is already attached to instances: 589899a5-db4e-4c26-9411-811a83bd6f35 Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:26.637684 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 656da4ab-ef37-4996-9997-c1760e7e9e8f is already attached to instances: 589899a5-db4e-4c26-9411-811a83bd6f35 Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:26.639164 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 656da4ab-ef37-4996-9997-c1760e7e9e8f is already attached to instances: 589899a5-db4e-4c26-9411-811a83bd6f35 Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 400 to user: Invalid volume: volume 656da4ab-ef37-4996-9997-c1760e7e9e8f is already attached to instances: 589899a5-db4e-4c26-9411-811a83bd6f35 {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-9933f028-8d1f-4b47-931e-4ae00ed54a0d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094114 Jun 18 05:26:26.640819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 548/1088] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:26:26 2022] POST /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:26:26.645713 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:26.646204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:26.652058 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.652511 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.653244 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.653710 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.679654 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:26:26.923717 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c5490341-1b7f-4521-8690-822879de8cb3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 204 len: 0 microversion: 2.1 time: 0.282031 Jun 18 05:26:26.924339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 541/1089] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:26:26 2022] DELETE /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:26:26.932655 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:26.933265 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:26.940172 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.940618 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:26.941394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:26.941845 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:27.077894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:27.085507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2b9014c3-9d3a-4465-bae1-5199b814bfee tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1682 microversion: 2.1 time: 0.156674 Jun 18 05:26:27.086079 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 549/1090] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:26 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:28.105689 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:28.106381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:28.113494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:28.113934 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:28.114682 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:28.115106 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:28.243512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:28.251171 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-55bc213e-3d50-4692-a22c-e7f069d43868 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1682 microversion: 2.1 time: 0.149779 Jun 18 05:26:28.255461 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 542/1091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:28 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:29.268759 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:29.269369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:29.276119 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:29.276497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:29.277250 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:29.277707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:29.340327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:29.347862 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-73d0a809-fe87-4a39-8470-73538f7e1045 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1614 microversion: 2.1 time: 0.083677 Jun 18 05:26:29.348422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 550/1092] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:29 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:29.512038 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-091d1416-b83c-4c24-b692-f4809c74d4c0 req-6d717563-0314-4f74-bb08-48c4026933c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87d5fa9-8c4d-4486-8fa8-dab86dcdb126", "name": "network-vif-deleted", "tag": "3143144b-5f00-4c85-b3d9-006144d97ae7"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:29.520542 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-091d1416-b83c-4c24-b692-f4809c74d4c0 req-6d717563-0314-4f74-bb08-48c4026933c2 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:29.520986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-091d1416-b83c-4c24-b692-f4809c74d4c0 req-6d717563-0314-4f74-bb08-48c4026933c2 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:29.532148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-091d1416-b83c-4c24-b692-f4809c74d4c0 req-6d717563-0314-4f74-bb08-48c4026933c2 service nova] Creating event network-vif-deleted:3143144b-5f00-4c85-b3d9-006144d97ae7 for instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 on hv-cinder-83699 Jun 18 05:26:29.537634 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-091d1416-b83c-4c24-b692-f4809c74d4c0 req-6d717563-0314-4f74-bb08-48c4026933c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029208 Jun 18 05:26:29.538234 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 543/1093] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:30.365858 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:30.366477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:30.373356 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:30.373941 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:30.374811 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:30.375270 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:30.442814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:30.450930 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4c55d62e-ef33-49ae-b347-08e7624933e4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1614 microversion: 2.1 time: 0.088834 Jun 18 05:26:30.451512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 551/1094] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:30 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:31.469690 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:31.470716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:31.477004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:31.477481 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:31.478269 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:31.478705 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:31.744999 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:31.752559 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2cb3e221-7c71-44cd-a450-eb75893435c5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 200 len: 1614 microversion: 2.1 time: 0.287625 Jun 18 05:26:31.753135 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 544/1095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:31 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 1614 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:32.770358 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:32.770962 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:32.777211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:32.777760 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:32.778515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:32.778943 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:32.793092 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 HTTP/1.1 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:26:32.794638 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:26:32.797639 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'c87d5fa9-8c4d-4486-8fa8-dab86dcdb126'} Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:26:32.798429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:26:32.800173 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:32.801268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:26:32.801268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-07ca24e1-27de-413b-b46b-c8f22f3c5864 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 404 len: 111 microversion: 2.1 time: 0.030226 Jun 18 05:26:32.801268 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 552/1096] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:32 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:26:32.804736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a9b91dad-b6b7-4808-890f-4a9f22a169c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '.version_select at 0x7f7b01549940>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:32.808101 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9b91dad-b6b7-4808-890f-4a9f22a169c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [81f8ef23-6b2c-4479-8f23-8e6ea2b83055] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 05:26:33.816336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9b91dad-b6b7-4808-890f-4a9f22a169c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [81f8ef23-6b2c-4479-8f23-8e6ea2b83055] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 42544. Jun 18 05:26:33.918889 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a9b91dad-b6b7-4808-890f-4a9f22a169c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-434781931" status: 202 len: 0 microversion: 2.1 time: 1.117897 Jun 18 05:26:33.919478 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 545/1097] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 05:26:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-434781931 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:26:34.691265 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:34.691776 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:34.698248 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:34.704246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:34.704246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:34.704246 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:34.882740 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lazy-loading 'services' on Instance uuid 589899a5-db4e-4c26-9411-811a83bd6f35 {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:26:35.066723 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-86dc39db-b611-4afb-b7bb-effa4650e1bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments/656da4ab-ef37-4996-9997-c1760e7e9e8f" status: 202 len: 0 microversion: 2.1 time: 0.379641 Jun 18 05:26:35.067332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 553/1098] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:26:34 2022] DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments/656da4ab-ef37-4996-9997-c1760e7e9e8f => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 05:26:35.085676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:35.085676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:35.085676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:35.085676 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:35.086581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:35.086581 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:35.090324 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:35.116159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-40f4702e-bf2d-4247-9213-80b8100d0ebd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Jun 18 05:26:35.116714 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 546/1099] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:26:35 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:36.128844 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:36.129951 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:36.136572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:36.137020 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:36.137813 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:36.138297 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:36.168176 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-383899cf-7c4c-4cc9-9d43-553190fa44bd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Jun 18 05:26:36.168727 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 554/1100] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:26:36 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:37.181087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:37.182026 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:37.189047 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:37.189662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:37.190497 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:37.190932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:37.219302 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-25bfb418-8dd2-4783-84e1-89f8cf492841 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042511 Jun 18 05:26:37.219859 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 547/1101] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:26:37 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:26:37.286786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:37.286786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:37.291870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:37.292319 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:37.293075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:37.293534 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:37.318278 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:26:37.529560 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-08a87aaa-3d90-482d-831d-d311612fb601 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 204 len: 0 microversion: 2.1 time: 0.249694 Jun 18 05:26:37.530058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 555/1102] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:26:37 2022] DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 05:26:37.541051 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:37.541693 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:37.550326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:37.550326 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:37.551040 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:37.551476 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:37.679738 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:37.687300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1488ccd1-0092-4cfa-869d-df88bd043caf tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1682 microversion: 2.1 time: 0.150213 Jun 18 05:26:37.687871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 548/1103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:37 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:38.706148 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:38.707362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:38.713853 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:38.714374 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:38.715150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:38.715579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:38.851253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:38.859023 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-331c0a3a-38c2-4461-b245-7a5ca21a9b67 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1682 microversion: 2.1 time: 0.157373 Jun 18 05:26:38.859622 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 556/1104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:38 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:39.876812 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:39.877437 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:39.884877 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:39.885318 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:39.886120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:39.886550 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:39.967029 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:39.975309 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d2e20939-5cb3-4094-93bc-55ebc0536492 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1614 microversion: 2.1 time: 0.102323 Jun 18 05:26:39.975881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 549/1105] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:39 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:40.229931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-985c3332-88d5-403a-b389-db60996a4176 req-4029a3db-f36c-423c-81be-33ce3db13c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589899a5-db4e-4c26-9411-811a83bd6f35", "name": "network-vif-deleted", "tag": "10fb6aa3-f962-4d43-b1f4-ceecf7c36670"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:40.238423 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-985c3332-88d5-403a-b389-db60996a4176 req-4029a3db-f36c-423c-81be-33ce3db13c91 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:40.238869 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-985c3332-88d5-403a-b389-db60996a4176 req-4029a3db-f36c-423c-81be-33ce3db13c91 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:40.250346 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-985c3332-88d5-403a-b389-db60996a4176 req-4029a3db-f36c-423c-81be-33ce3db13c91 service nova] Creating event network-vif-deleted:10fb6aa3-f962-4d43-b1f4-ceecf7c36670 for instance 589899a5-db4e-4c26-9411-811a83bd6f35 on hv-cinder-83699 Jun 18 05:26:40.256071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-985c3332-88d5-403a-b389-db60996a4176 req-4029a3db-f36c-423c-81be-33ce3db13c91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029916 Jun 18 05:26:40.256663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 557/1106] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:40.992325 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:40.992942 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:40.999906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:41.000349 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:41.001166 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:41.001659 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:41.037350 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:41.037836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:41.038300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lazy-loading 'fault' on Instance uuid 589899a5-db4e-4c26-9411-811a83bd6f35 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:26:41.081997 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:41.089790 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-4dcd5c9c-028c-4078-9cc7-19f3d3ef8bba tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 200 len: 1330 microversion: 2.1 time: 0.101448 Jun 18 05:26:41.090916 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 550/1107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:40 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:42.109207 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:42.109945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:42.118406 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:42.118861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:42.119756 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:42.120190 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:42.135534 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 HTTP/1.1 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:26:42.137146 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:26:42.138894 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '589899a5-db4e-4c26-9411-811a83bd6f35'} Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:26:42.140039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:26:42.141674 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:26:42.143430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:26:42.143430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5d8abd59-69dd-4e2a-a38c-96c29080237b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 404 len: 111 microversion: 2.1 time: 0.034155 Jun 18 05:26:42.143430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 558/1108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:42 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:26:42.147824 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-1b7eb99b-d501-4cec-8f01-9c349156550e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '.version_select at 0x7f7b01eaa790>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:42.221494 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-1b7eb99b-d501-4cec-8f01-9c349156550e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71144994" status: 202 len: 0 microversion: 2.1 time: 0.077975 Jun 18 05:26:42.225854 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 551/1109] 10.222.0.23 () {58 vars in 1214 bytes} [Sat Jun 18 05:26:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71144994 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:26:42.334555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:26:42.334800 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:26:42.943963 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-cef061dd-5125-4ee6-b7e4-9890e0f96ada tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: .version_select at 0x7f7b03d42040>, body: {"keypair": {"name": "tempest-keypair-1509217114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2/YSIPIlwAfg3D89kmSQL+cU0QyCf3lhcbU+4H2XCzSwb90G92niNc6Cc+xf0OEosy6/tnPkcubx4lhzGjxAPFl3TgcgMI4jVAyxJbpF2J4+g7FUU4TLglla4sCZMTPw=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:42.948015 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:42.959862 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-cef061dd-5125-4ee6-b7e4-9890e0f96ada tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:26:42.963742 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-cef061dd-5125-4ee6-b7e4-9890e0f96ada tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:26:43.050564 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-cef061dd-5125-4ee6-b7e4-9890e0f96ada tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110523 Jun 18 05:26:43.051151 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 559/1110] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:26:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:45.496656 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1249789251", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c244710-1fba-414f-9d04-4fcd88e7ed14"}], "security_groups": [{"name": "tempest-securitygroup--282519626"}], "key_name": "tempest-keypair-1509217114", "user_data": "}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:45.599139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.network.neutron [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] validate_networks() for [('1c244710-1fba-414f-9d04-4fcd88e7ed14', None, None, None, None, None)] {{(pid=117990) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:26:45.966223 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:26:45.966640 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image limits 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:26:45.967104 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:26:45.967505 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image pref 0:0:0 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:26:45.967909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.virt.hardware [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:26:45.977348 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:45.977822 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:45.978607 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:45.979044 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:45.995876 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:26:45.999733 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.quota [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117990) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:26:46.010781 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Going to run 1 instances... {{(pid=117990) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:26:46.012995 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117990) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:26:46.149183 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bdf42bad-286b-4416-be6b-4953e4cc8301 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.657898 Jun 18 05:26:46.149871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 552/1111] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:26:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:26:46.161664 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-4b845929-0e4d-462a-8b9d-b8ae9ad95b8c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:46.162291 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-4b845929-0e4d-462a-8b9d-b8ae9ad95b8c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:46.219063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-4b845929-0e4d-462a-8b9d-b8ae9ad95b8c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:46.227028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-4b845929-0e4d-462a-8b9d-b8ae9ad95b8c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1242 microversion: 2.1 time: 0.070896 Jun 18 05:26:46.228565 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 560/1112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:46 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:47.245487 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:47.246102 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:47.252291 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:47.252894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:47.254522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:47.254909 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:47.321306 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:47.328912 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e38b99ea-7a73-489f-9e46-717672b646d5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1238 microversion: 2.1 time: 0.088058 Jun 18 05:26:47.329833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 553/1113] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:47 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:48.346441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:48.347080 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:48.353595 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:48.354047 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:48.354814 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:48.355251 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:48.359290 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:48.419309 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:48.427489 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-85629708-a764-4635-8bbe-51a020256569 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1300 microversion: 2.1 time: 0.085040 Jun 18 05:26:48.428086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 561/1114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:48 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:49.449199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:49.449842 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:49.456449 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:49.456905 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:49.459567 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:49.459567 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:49.686616 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:49.696055 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-5b1893db-5e6d-4ff0-be40-a30d554c08dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1367 microversion: 2.1 time: 0.250609 Jun 18 05:26:49.696926 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 554/1115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:49 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:49.927825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-c6dc8a81-a02b-4459-845a-dc685fb62865 req-a4e1659c-d12b-4966-a90f-65270618ea0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6c072b-d718-4472-84dd-c382b4a3c51e", "tag": "34ef2a79-8d24-47b1-b652-a70000ed7299"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:49.938583 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c6dc8a81-a02b-4459-845a-dc685fb62865 req-a4e1659c-d12b-4966-a90f-65270618ea0b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:49.939022 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c6dc8a81-a02b-4459-845a-dc685fb62865 req-a4e1659c-d12b-4966-a90f-65270618ea0b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:49.952048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-c6dc8a81-a02b-4459-845a-dc685fb62865 req-a4e1659c-d12b-4966-a90f-65270618ea0b service nova] Creating event network-changed:34ef2a79-8d24-47b1-b652-a70000ed7299 for instance 5d6c072b-d718-4472-84dd-c382b4a3c51e on hv-cinder-83699 Jun 18 05:26:49.957206 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-c6dc8a81-a02b-4459-845a-dc685fb62865 req-a4e1659c-d12b-4966-a90f-65270618ea0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034081 Jun 18 05:26:49.957847 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 562/1116] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:50.714137 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:50.714840 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:50.720953 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:50.721447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:50.722224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:50.723265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:50.852464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:50.859898 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-51d0de3d-dc1e-49a8-95da-8e9b8b53d706 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1367 microversion: 2.1 time: 0.150093 Jun 18 05:26:50.860464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 555/1117] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:50 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:51.877544 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:51.878245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:51.885721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:51.889983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:51.889983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:51.889983 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:52.016197 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:52.024504 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a3bdaa78-f1b8-41df-892b-1ac768803665 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1367 microversion: 2.1 time: 0.151961 Jun 18 05:26:52.025072 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 563/1118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:51 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:53.042071 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:53.042691 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:53.049234 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:53.049715 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:53.050479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:53.051501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:53.177327 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:53.184783 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fc152e53-3a0f-4cb4-b8a3-b8a2d5038c4a tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1367 microversion: 2.1 time: 0.146545 Jun 18 05:26:53.185360 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 556/1119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:53 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:54.059859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-cdf8af52-eb6d-4f7f-9496-642cb7876a35 req-cf013a28-c6c5-4504-96f6-d6b7de285f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6c072b-d718-4472-84dd-c382b4a3c51e", "name": "network-vif-plugged", "status": "completed", "tag": "34ef2a79-8d24-47b1-b652-a70000ed7299"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:54.068976 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-cdf8af52-eb6d-4f7f-9496-642cb7876a35 req-cf013a28-c6c5-4504-96f6-d6b7de285f80 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:54.069542 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-cdf8af52-eb6d-4f7f-9496-642cb7876a35 req-cf013a28-c6c5-4504-96f6-d6b7de285f80 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:54.080075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-cdf8af52-eb6d-4f7f-9496-642cb7876a35 req-cf013a28-c6c5-4504-96f6-d6b7de285f80 service nova] Creating event network-vif-plugged:34ef2a79-8d24-47b1-b652-a70000ed7299 for instance 5d6c072b-d718-4472-84dd-c382b4a3c51e on hv-cinder-83699 Jun 18 05:26:54.085816 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-cdf8af52-eb6d-4f7f-9496-642cb7876a35 req-cf013a28-c6c5-4504-96f6-d6b7de285f80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Jun 18 05:26:54.086389 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 564/1120] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:26:54.202793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:54.203405 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:54.210794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:54.211246 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:54.212053 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:54.212491 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:54.344887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:54.352735 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-25d18bf9-ce97-4615-a82e-17775e0a27dd tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1367 microversion: 2.1 time: 0.153820 Jun 18 05:26:54.353323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 557/1121] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:54 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:55.370853 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:55.371567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:55.378222 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:55.378744 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:55.379500 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:55.380454 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:55.511030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:55.518378 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6ee0f08d-d660-4d1e-b688-fe17ba9bef75 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1367 microversion: 2.1 time: 0.151745 Jun 18 05:26:55.518945 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 565/1122] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:55 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:56.537157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:56.537736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:56.540089 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:56.540742 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=6 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:56.541454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:56.546192 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:56.546639 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:56.547473 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:56.552688 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:56.682186 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:26:56.690418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-41372373-d08c-4720-aed5-b1d47c474619 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1558 microversion: 2.1 time: 0.158516 Jun 18 05:26:56.690977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 558/1123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:26:56 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:26:56.706467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:26:56.707543 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:26:56.709605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=6 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:26:56.714950 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:56.715447 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:56.716214 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:56.716653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:56.792647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-18d6b528-3768-4e59-9a83-a8b6766ff39c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089997 Jun 18 05:26:56.793231 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 566/1124] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:26:56 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:26:58.135405 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-b0bae35b-248c-4228-9b90-52ee6f0e6396 req-fb30bee5-14c3-49ef-a903-e2c82ba56586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6c072b-d718-4472-84dd-c382b4a3c51e", "tag": "34ef2a79-8d24-47b1-b652-a70000ed7299"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:26:58.143762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-b0bae35b-248c-4228-9b90-52ee6f0e6396 req-fb30bee5-14c3-49ef-a903-e2c82ba56586 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:26:58.144206 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-b0bae35b-248c-4228-9b90-52ee6f0e6396 req-fb30bee5-14c3-49ef-a903-e2c82ba56586 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:26:58.156518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-b0bae35b-248c-4228-9b90-52ee6f0e6396 req-fb30bee5-14c3-49ef-a903-e2c82ba56586 service nova] Creating event network-changed:34ef2a79-8d24-47b1-b652-a70000ed7299 for instance 5d6c072b-d718-4472-84dd-c382b4a3c51e on hv-cinder-83699 Jun 18 05:26:58.162645 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-b0bae35b-248c-4228-9b90-52ee6f0e6396 req-fb30bee5-14c3-49ef-a903-e2c82ba56586 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155211 Jun 18 05:26:58.163248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 559/1125] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:34.307456 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:27:34.308212 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=25 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:27:34.312109 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:34.312593 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:34.318653 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:34.326098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:34.326098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:34.326098 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:34.343556 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-281500a2-cfa0-4048-bb3f-e9e784fa21ea tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/ips" status: 200 len: 151 microversion: 2.1 time: 0.037707 Jun 18 05:27:34.344116 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 567/1126] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:27:34 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:35.837229 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:27:35.837992 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=71 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:27:35.842204 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0515e6a5-4688-45e4-a104-7a3ce9c5eb83"}} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:35.843346 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:35.850397 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:35.851756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:35.851756 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:35.852169 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:36.635695 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b2089d51-d921-4941-aae6-c61d154baed7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799770 Jun 18 05:27:36.636381 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 560/1127] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:27:35 2022] POST /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:38.768733 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:38.769830 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:38.771366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-f1bab55a-44ce-49af-aea1-51cfbe920ee7 req-845b0562-88af-4315-8088-a25e2635dbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6e312a-e89e-46b8-8651-d8af33b96e1b", "tag": "30ebdd42-475a-47af-a0f7-18a2a06c0df9"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:38.778385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:38.779118 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:38.780091 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:38.780718 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-f1bab55a-44ce-49af-aea1-51cfbe920ee7 req-845b0562-88af-4315-8088-a25e2635dbb7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:38.781025 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:38.781287 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-f1bab55a-44ce-49af-aea1-51cfbe920ee7 req-845b0562-88af-4315-8088-a25e2635dbb7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:38.794221 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-f1bab55a-44ce-49af-aea1-51cfbe920ee7 req-845b0562-88af-4315-8088-a25e2635dbb7 service nova] Creating event network-changed:30ebdd42-475a-47af-a0f7-18a2a06c0df9 for instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b on hv-cinder-83699 Jun 18 05:27:38.800626 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-f1bab55a-44ce-49af-aea1-51cfbe920ee7 req-845b0562-88af-4315-8088-a25e2635dbb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Jun 18 05:27:38.801932 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 561/1128] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:27:38.820632 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:27:39.140663 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-964d5ef6-0402-4497-a92b-4ea7b76cdf34 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 204 len: 0 microversion: 2.1 time: 0.375638 Jun 18 05:27:39.141351 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 568/1129] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:27:38 2022] DELETE /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:27:39.151440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:39.152460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:39.158907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:39.159352 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:39.160108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:39.160796 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:39.311136 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:39.319338 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fcabd89a-582b-44b3-868b-1c924a6f74da tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1577 microversion: 2.1 time: 0.173308 Jun 18 05:27:39.319908 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 562/1130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:39 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:40.337181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:40.337897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:40.344478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:40.344935 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:40.345718 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:40.346150 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:40.478394 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:40.485803 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b0992a9b-e35e-407f-b9f7-d390b36976e2 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1577 microversion: 2.1 time: 0.153352 Jun 18 05:27:40.486359 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 569/1131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:40 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:41.344910 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-13ff0513-bd4d-4c46-9e3e-f54c88d2374d req-4f200e9f-a34b-4efe-8817-b9520210a79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e312a-e89e-46b8-8651-d8af33b96e1b", "name": "network-vif-deleted", "tag": "30ebdd42-475a-47af-a0f7-18a2a06c0df9"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:41.353739 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-13ff0513-bd4d-4c46-9e3e-f54c88d2374d req-4f200e9f-a34b-4efe-8817-b9520210a79b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:41.354176 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-13ff0513-bd4d-4c46-9e3e-f54c88d2374d req-4f200e9f-a34b-4efe-8817-b9520210a79b service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:41.365341 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-13ff0513-bd4d-4c46-9e3e-f54c88d2374d req-4f200e9f-a34b-4efe-8817-b9520210a79b service nova] Creating event network-vif-deleted:30ebdd42-475a-47af-a0f7-18a2a06c0df9 for instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b on hv-cinder-83699 Jun 18 05:27:41.370091 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-13ff0513-bd4d-4c46-9e3e-f54c88d2374d req-4f200e9f-a34b-4efe-8817-b9520210a79b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028824 Jun 18 05:27:41.374753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 563/1132] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:41.502965 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:41.503579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:41.510675 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:41.511115 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:41.511871 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:41.512298 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:41.575216 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:41.582667 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-7d1724e1-edb9-4859-a193-f5b730fcc7de tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 200 len: 1224 microversion: 2.1 time: 0.083652 Jun 18 05:27:41.583227 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 570/1133] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:41 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:42.601699 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:42.602344 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 1e6e312a-e89e-46b8-8651-d8af33b96e1b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:42.608643 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:42.609120 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:42.614845 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:42.614845 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:42.625062 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] HTTP exception thrown: Instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b could not be found. Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Request method failure captured: Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b HTTP/1.1 Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWCHsrCn9xlk1TNZ9USpUNzb5tvtDu_IkeuwTJpOlCYXmHscAEjuydQ1EsKAkdbsHtKYQNeoxLdqk85fxrbMZwr9vlkecJe2CElokjPd0pLz17bVMz_jDrmW4H-NtnSSYqjNzMNBdihz36D0qCQT4FBhasjFkcfmE6wVSFIEumbuAYg Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:27:42.626729 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5e4aece32ff462b9b9a42200d584c1b"}]}] Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 6d24c8fbdc7246e2af87004f2985a9f5 Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b could not be found. Jun 18 05:27:42.628311 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '1e6e312a-e89e-46b8-8651-d8af33b96e1b'} Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b could not be found. Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:27:42.629139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b could not be found. Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b could not be found. Jun 18 05:27:42.630506 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:42.633202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Returning 404 to user: Instance 1e6e312a-e89e-46b8-8651-d8af33b96e1b could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:27:42.633202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b2175692-7b2b-4823-97e2-dd746a12547c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b" status: 404 len: 111 microversion: 2.1 time: 0.031802 Jun 18 05:27:42.633202 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 564/1134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:42 2022] GET /compute/v2.1/servers/1e6e312a-e89e-46b8-8651-d8af33b96e1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:27:44.159839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0515e6a5-4688-45e4-a104-7a3ce9c5eb83"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:44.160949 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:44.168069 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:44.168515 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:44.169272 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:44.169737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:44.246072 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Invalid volume: volume 0515e6a5-4688-45e4-a104-7a3ce9c5eb83 is already attached to instances: 5d6c072b-d718-4472-84dd-c382b4a3c51e Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: POST /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments HTTP/1.1 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 74 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:27:44.247881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {"volumeAttachment": {"volumeId": "0515e6a5-4688-45e4-a104-7a3ce9c5eb83"}} Jun 18 05:27:44.249529 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Invalid volume: volume 0515e6a5-4688-45e4-a104-7a3ce9c5eb83 is already attached to instances: 5d6c072b-d718-4472-84dd-c382b4a3c51e Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'server_id': '5d6c072b-d718-4472-84dd-c382b4a3c51e', 'body': {'volumeAttachment': {'volumeId': '0515e6a5-4688-45e4-a104-7a3ce9c5eb83'}}} Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0515e6a5-4688-45e4-a104-7a3ce9c5eb83 is already attached to instances: 5d6c072b-d718-4472-84dd-c382b4a3c51e Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:44.250567 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0515e6a5-4688-45e4-a104-7a3ce9c5eb83 is already attached to instances: 5d6c072b-d718-4472-84dd-c382b4a3c51e Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:44.251996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0515e6a5-4688-45e4-a104-7a3ce9c5eb83 is already attached to instances: 5d6c072b-d718-4472-84dd-c382b4a3c51e Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 400 to user: Invalid volume: volume 0515e6a5-4688-45e4-a104-7a3ce9c5eb83 is already attached to instances: 5d6c072b-d718-4472-84dd-c382b4a3c51e {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-f6fde0a4-247e-4b5a-a5d1-89b319fb1032 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093888 Jun 18 05:27:44.253503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 571/1135] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:27:44 2022] POST /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 05:27:44.311762 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:44.312258 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:44.318667 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:44.319161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:44.320582 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:44.321021 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:44.402317 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lazy-loading 'services' on Instance uuid 5d6c072b-d718-4472-84dd-c382b4a3c51e {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:27:44.624956 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-315e2b44-9598-4b40-9cdc-4ece72cef848 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments/0515e6a5-4688-45e4-a104-7a3ce9c5eb83" status: 202 len: 0 microversion: 2.1 time: 0.317115 Jun 18 05:27:44.625753 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 565/1136] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:27:44 2022] DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments/0515e6a5-4688-45e4-a104-7a3ce9c5eb83 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:27:44.634696 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:44.635703 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:44.642442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:44.642897 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:44.643652 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:44.644088 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:44.675625 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e4efb25f-5302-44cf-a496-c639f7914f77 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045620 Jun 18 05:27:44.676177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 572/1137] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:27:44 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:45.689361 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:45.690465 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:45.697094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:45.703153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:45.703153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:45.703153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:45.728225 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-a78c2fe9-8763-4bb8-9058-d4ccf12e2857 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Jun 18 05:27:45.728982 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 566/1138] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:27:45 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:45.898021 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:45.899037 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:45.900823 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-a6c689df-dfcd-4d18-a54e-9705ad3eb330 req-dac14a2d-1e83-4041-b451-3e6a7075fa76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d167251a-f398-4442-a5b0-f75ab2d4d1b4", "tag": "f1e35c87-41ca-48fb-a045-921ff1c239b0"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:45.909814 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-a6c689df-dfcd-4d18-a54e-9705ad3eb330 req-dac14a2d-1e83-4041-b451-3e6a7075fa76 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:45.910263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-a6c689df-dfcd-4d18-a54e-9705ad3eb330 req-dac14a2d-1e83-4041-b451-3e6a7075fa76 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:45.913399 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:45.913845 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:45.914707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:45.915168 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:45.923139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-a6c689df-dfcd-4d18-a54e-9705ad3eb330 req-dac14a2d-1e83-4041-b451-3e6a7075fa76 service nova] Creating event network-changed:f1e35c87-41ca-48fb-a045-921ff1c239b0 for instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 on hv-cinder-83699 Jun 18 05:27:45.928081 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-a6c689df-dfcd-4d18-a54e-9705ad3eb330 req-dac14a2d-1e83-4041-b451-3e6a7075fa76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032039 Jun 18 05:27:45.929366 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 567/1139] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:45.947118 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:27:46.254951 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-ed31e04e-9840-4765-9c6d-120572dabeed tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 204 len: 0 microversion: 2.1 time: 0.362206 Jun 18 05:27:46.255768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 573/1140] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:27:45 2022] DELETE /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:27:46.265004 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:46.266017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:46.273041 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:46.273538 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:46.274316 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:46.274994 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:46.416954 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:46.424906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8f922a8d-6331-435d-b7cd-16dc202dc48d tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1578 microversion: 2.1 time: 0.164475 Jun 18 05:27:46.425502 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 568/1141] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:46 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:46.740094 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:46.741189 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:46.747333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:46.747786 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:46.748560 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:46.748996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:46.782865 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-aa3967ff-319d-4554-896a-83f6bc9823de tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046913 Jun 18 05:27:46.783503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 574/1142] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:27:46 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:27:46.840794 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:46.841460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:46.847836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:46.848957 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:46.849150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:46.849501 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:46.876588 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Going to try to terminate instance {{(pid=117990) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:27:47.162748 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8f924163-3314-465c-8e73-f47fcfec6417 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 204 len: 0 microversion: 2.1 time: 0.325468 Jun 18 05:27:47.163518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 569/1143] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:27:46 2022] DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:27:47.171435 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:47.172049 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:47.179654 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:47.180204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:47.180969 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:47.181566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:47.313805 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:47.322018 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d48c194d-f314-4051-95a9-4403cef11c31 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1683 microversion: 2.1 time: 0.154458 Jun 18 05:27:47.322576 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 575/1144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:47 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:27:47.443108 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:47.443490 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:47.450161 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:47.455862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:47.455862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:47.455862 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:47.587339 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:47.594951 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-57d5234f-fbac-4dd0-8a72-c649c83f4229 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1578 microversion: 2.1 time: 0.156405 Jun 18 05:27:47.595522 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 570/1145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:47 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:48.339843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:48.340458 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:48.347038 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:48.347489 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:48.348245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:48.348685 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:48.480339 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:48.487798 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-5b8e0a9b-cea0-4563-bfcf-8fbc6970f3f7 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1683 microversion: 2.1 time: 0.151884 Jun 18 05:27:48.488367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 576/1146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:48 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:48.611964 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:48.612515 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:48.619115 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:48.619563 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:48.620320 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:48.620755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:48.749686 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:48.757641 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-44f11a6a-9da2-4000-bf9c-ef3ad309e3d7 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1578 microversion: 2.1 time: 0.149538 Jun 18 05:27:48.758206 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 571/1147] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:48 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:49.504553 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:49.505171 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:49.512356 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:49.512810 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:49.513691 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:49.514128 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:49.774900 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:49.775547 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:49.781996 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:49.782446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:49.783471 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:49.783906 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:49.864824 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:49.873993 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e3232355-9dff-494d-887e-22488e2c33ed tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1683 microversion: 2.1 time: 0.373817 Jun 18 05:27:49.884216 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 577/1148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:49 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1683 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:49.969287 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:49.979150 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c9ab4a94-debb-45ed-8db2-fba5635df1fb tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1459 microversion: 2.1 time: 0.208205 Jun 18 05:27:49.989131 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 572/1149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:49 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1459 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 05:27:50.279676 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-c75d50eb-0e93-4498-b230-e32cb22e233a req-0a4a7e92-d6e5-4388-b3ab-60188f33a9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d167251a-f398-4442-a5b0-f75ab2d4d1b4", "name": "network-vif-deleted", "tag": "f1e35c87-41ca-48fb-a045-921ff1c239b0"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:50.288809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c75d50eb-0e93-4498-b230-e32cb22e233a req-0a4a7e92-d6e5-4388-b3ab-60188f33a9dd service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:50.289359 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c75d50eb-0e93-4498-b230-e32cb22e233a req-0a4a7e92-d6e5-4388-b3ab-60188f33a9dd service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:50.295836 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-fe22b953-3163-4559-aecd-115c5f7a0c16 req-064fd4b8-c157-41a8-99ed-61e5c877cd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6c072b-d718-4472-84dd-c382b4a3c51e", "name": "network-vif-deleted", "tag": "34ef2a79-8d24-47b1-b652-a70000ed7299"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:50.301467 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-c75d50eb-0e93-4498-b230-e32cb22e233a req-0a4a7e92-d6e5-4388-b3ab-60188f33a9dd service nova] Creating event network-vif-deleted:f1e35c87-41ca-48fb-a045-921ff1c239b0 for instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 on hv-cinder-83699 Jun 18 05:27:50.306869 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-c75d50eb-0e93-4498-b230-e32cb22e233a req-0a4a7e92-d6e5-4388-b3ab-60188f33a9dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Jun 18 05:27:50.307563 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 578/1150] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:50.312056 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-fe22b953-3163-4559-aecd-115c5f7a0c16 req-064fd4b8-c157-41a8-99ed-61e5c877cd3f service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:50.312551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-fe22b953-3163-4559-aecd-115c5f7a0c16 req-064fd4b8-c157-41a8-99ed-61e5c877cd3f service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:50.325256 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-fe22b953-3163-4559-aecd-115c5f7a0c16 req-064fd4b8-c157-41a8-99ed-61e5c877cd3f service nova] Creating event network-vif-deleted:34ef2a79-8d24-47b1-b652-a70000ed7299 for instance 5d6c072b-d718-4472-84dd-c382b4a3c51e on hv-cinder-83699 Jun 18 05:27:50.331292 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-fe22b953-3163-4559-aecd-115c5f7a0c16 req-064fd4b8-c157-41a8-99ed-61e5c877cd3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040035 Jun 18 05:27:50.332157 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 573/1151] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 05:27:50.893016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:50.893820 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:50.900619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:50.901071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:50.901995 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:50.902429 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:50.934768 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:50.935221 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:50.935669 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.objects.instance [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lazy-loading 'fault' on Instance uuid 5d6c072b-d718-4472-84dd-c382b4a3c51e {{(pid=117991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:27:50.981541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:50.989070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a5764b6c-f685-47eb-9286-f4ebe3f3fc5d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 200 len: 1332 microversion: 2.1 time: 0.100821 Jun 18 05:27:50.998826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 579/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:50 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:51.004489 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:51.005185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:51.012323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:51.012765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:51.013546 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:51.013978 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:51.048971 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:51.049551 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:51.050001 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lazy-loading 'fault' on Instance uuid d167251a-f398-4442-a5b0-f75ab2d4d1b4 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:27:51.097435 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d24c8fbdc7246e2af87004f2985a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4aece32ff462b9b9a42200d584c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:51.105643 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-dae4f62c-11a2-4623-8423-72f10d589f36 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 200 len: 1230 microversion: 2.1 time: 0.105157 Jun 18 05:27:51.106227 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 574/1153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:50 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:52.006441 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:52.007085 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:52.013625 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:52.014058 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:52.014821 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:52.015259 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:52.028354 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e HTTP/1.1 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:27:52.037407 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:27:52.039826 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '5d6c072b-d718-4472-84dd-c382b4a3c51e'} Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:27:52.040778 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:27:52.042430 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.043873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:27:52.043873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b1f786eb-86ce-4b76-8ff1-c2b771fcdec0 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 404 len: 111 microversion: 2.1 time: 0.028843 Jun 18 05:27:52.043873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 580/1154] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:52 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 05:27:52.044145 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-9f8ea855-168e-40bd-aee1-b7802f58c09f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '.version_select at 0x7f7b01e78f70>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:52.123017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:52.123631 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: d167251a-f398-4442-a5b0-f75ab2d4d1b4] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:52.129839 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:52.130365 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:52.131132 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:52.131573 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:52.144864 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] HTTP exception thrown: Instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 could not be found. Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Request method failure captured: Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 HTTP/1.1 Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWCHsrCn9xlk1TNZ9USpUNzb5tvtDu_IkeuwTJpOlCYXmHscAEjuydQ1EsKAkdbsHtKYQNeoxLdqk85fxrbMZwr9vlkecJe2CElokjPd0pLz17bVMz_jDrmW4H-NtnSSYqjNzMNBdihz36D0qCQT4FBhasjFkcfmE6wVSFIEumbuAYg Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:27:52.146402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5e4aece32ff462b9b9a42200d584c1b"}]}] Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 6d24c8fbdc7246e2af87004f2985a9f5 Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 could not be found. Jun 18 05:27:52.148409 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'd167251a-f398-4442-a5b0-f75ab2d4d1b4'} Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 could not be found. Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:27:52.149266 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 could not be found. Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 could not be found. Jun 18 05:27:52.151123 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:52.152420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Returning 404 to user: Instance d167251a-f398-4442-a5b0-f75ab2d4d1b4 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:27:52.152420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-6c8ac5dd-6fa6-4bdb-892c-8f513c017f24 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4" status: 404 len: 111 microversion: 2.1 time: 0.028638 Jun 18 05:27:52.152420 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 581/1155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:52 2022] GET /compute/v2.1/servers/d167251a-f398-4442-a5b0-f75ab2d4d1b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 05:27:52.155793 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-9f8ea855-168e-40bd-aee1-b7802f58c09f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509217114" status: 202 len: 0 microversion: 2.1 time: 0.119143 Jun 18 05:27:52.156370 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 575/1156] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Jun 18 05:27:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509217114 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:27:53.009917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:53.010484 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:53.016803 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:53.019133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:53.019133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:53.019133 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:53.022501 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:27:53.034248 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] HTTP exception thrown: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Request method failure captured: Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b HTTP/1.1 Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWCHsrCn9xlk1TNZ9USpUNzb5tvtDu_IkeuwTJpOlCYXmHscAEjuydQ1EsKAkdbsHtKYQNeoxLdqk85fxrbMZwr9vlkecJe2CElokjPd0pLz17bVMz_jDrmW4H-NtnSSYqjNzMNBdihz36D0qCQT4FBhasjFkcfmE6wVSFIEumbuAYg Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:27:53.035812 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5e4aece32ff462b9b9a42200d584c1b"}]}] Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: 6d24c8fbdc7246e2af87004f2985a9f5 Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.037473 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '0862f974-0f40-4c61-95a9-9c0e1db65a4b'} Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:27:53.038505 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.040605 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.042566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Returning 404 to user: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:27:53.042566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-855c2797-27a6-486f-a1ef-37b5cfd8874c tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 404 len: 111 microversion: 2.1 time: 0.032156 Jun 18 05:27:53.042566 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 582/1157] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:27:53 2022] DELETE /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:27:53.047930 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:53.048759 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] [instance: 0862f974-0f40-4c61-95a9-9c0e1db65a4b] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:53.056533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:53.056976 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:53.057955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:53.058416 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:53.071869 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] HTTP exception thrown: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Request method failure captured: Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b HTTP/1.1 Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWCHsrCn9xlk1TNZ9USpUNzb5tvtDu_IkeuwTJpOlCYXmHscAEjuydQ1EsKAkdbsHtKYQNeoxLdqk85fxrbMZwr9vlkecJe2CElokjPd0pLz17bVMz_jDrmW4H-NtnSSYqjNzMNBdihz36D0qCQT4FBhasjFkcfmE6wVSFIEumbuAYg Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:27:53.073553 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5e4aece32ff462b9b9a42200d584c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5e4aece32ff462b9b9a42200d584c1b"}]}] Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: e5e4aece32ff462b9b9a42200d584c1b Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-TestVolumeBootPattern-2140324561 Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: 6d24c8fbdc7246e2af87004f2985a9f5 Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-TestVolumeBootPattern-2140324561-project Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.074958 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '0862f974-0f40-4c61-95a9-9c0e1db65a4b'} Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:27:53.075736 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. Jun 18 05:27:53.076985 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:27:53.078153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Returning 404 to user: Instance 0862f974-0f40-4c61-95a9-9c0e1db65a4b could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:27:53.078153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b1578a56-83cd-4df2-96fc-c941ba9c21be tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b" status: 404 len: 111 microversion: 2.1 time: 0.030988 Jun 18 05:27:53.078153 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 576/1158] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:53 2022] GET /compute/v2.1/servers/0862f974-0f40-4c61-95a9-9c0e1db65a4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:27:53.376727 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a7e23367-7658-4ea5-ab8e-cd91cae63788 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: .version_select at 0x7f7b00f3f700>, body: {"keypair": {"name": "tempest-keypair-973874804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHILeQJO9tfM2OL4u2SrpCGVCqQ+iFPdR7odRq1V2nagXmwQDV5XC8WtlBvPSxEB5f1sK7mzInGg+GGnETtAVO4ApSxzLI48xK10ojysZLG9w2rs3xdofovxRDDuGHvUCA=="}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:53.391349 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-a7e23367-7658-4ea5-ab8e-cd91cae63788 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:27:53.395186 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-a7e23367-7658-4ea5-ab8e-cd91cae63788 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'key_pairs'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:27:53.460898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a7e23367-7658-4ea5-ab8e-cd91cae63788 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087915 Jun 18 05:27:53.461556 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 583/1159] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 05:27:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:27:54.550479 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-704dcbb5-85b1-4475-b2a9-02e86eb4d6e8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] Calling method '.version_select at 0x7f7b0202d430>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:54.649369 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-704dcbb5-85b1-4475-b2a9-02e86eb4d6e8 tempest-TestVolumeBootPattern-2140324561 tempest-TestVolumeBootPattern-2140324561-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-330640060" status: 202 len: 0 microversion: 2.1 time: 0.102705 Jun 18 05:27:54.649967 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 577/1160] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Jun 18 05:27:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-330640060 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:27:55.794211 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-28489200", "imageRef": "7557e721-6355-4ddf-bb6a-290ba2831d6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c244710-1fba-414f-9d04-4fcd88e7ed14"}], "security_groups": [{"name": "tempest-securitygroup--858942698"}], "key_name": "tempest-keypair-973874804", "user_data": "}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:27:55.923052 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.network.neutron [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] validate_networks() for [('1c244710-1fba-414f-9d04-4fcd88e7ed14', None, None, None, None, None)] {{(pid=117991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 05:27:56.400734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 05:27:56.401421 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image limits 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 05:27:56.402099 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Flavor pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 05:27:56.402578 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Image pref 0:0:0 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 05:27:56.403075 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.virt.hardware [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 05:27:56.412621 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:56.413103 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:56.413935 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:56.414367 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:56.431693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 05:27:56.435808 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.quota [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Getting quotas for user e5dc9999f6664c23855b66670f7d6a98 and project 81c38b2c1ae4484bbf2d4939470f45e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 05:27:56.447546 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Going to run 1 instances... {{(pid=117991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 05:27:56.449843 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7557e721-6355-4ddf-bb6a-290ba2831d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 05:27:56.582570 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e0e9cd1e-4a6d-4791-ac06-9460bf59613c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.793805 Jun 18 05:27:56.589003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 584/1161] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 05:27:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 05:27:56.594872 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-2623d39e-b677-4e71-8df6-40a2d9ae24fc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:56.596555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-2623d39e-b677-4e71-8df6-40a2d9ae24fc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:56.660208 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-2623d39e-b677-4e71-8df6-40a2d9ae24fc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:56.668680 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-2623d39e-b677-4e71-8df6-40a2d9ae24fc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1239 microversion: 2.1 time: 0.078338 Jun 18 05:27:56.672853 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 578/1162] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:56 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:57.689086 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-64aa7bdb-b36f-4557-a514-3817c8e5d74d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:57.689881 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-64aa7bdb-b36f-4557-a514-3817c8e5d74d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:57.766737 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-64aa7bdb-b36f-4557-a514-3817c8e5d74d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:57.780033 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-64aa7bdb-b36f-4557-a514-3817c8e5d74d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1239 microversion: 2.1 time: 0.093665 Jun 18 05:27:57.781315 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 585/1163] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:57 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:58.797518 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-807bd71f-efef-4eab-a40d-2312c42d6c7e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:58.798131 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-807bd71f-efef-4eab-a40d-2312c42d6c7e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:58.860403 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-807bd71f-efef-4eab-a40d-2312c42d6c7e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:58.866675 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-807bd71f-efef-4eab-a40d-2312c42d6c7e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1239 microversion: 2.1 time: 0.073039 Jun 18 05:27:58.867467 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 579/1164] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:58 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:27:59.883693 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:27:59.884360 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:27:59.891162 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:59.891720 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:59.892500 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:27:59.892931 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:27:59.962195 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:27:59.970477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-360a1626-cae8-4402-926e-5bb0dff5a6d8 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1243 microversion: 2.1 time: 0.091284 Jun 18 05:27:59.971060 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 586/1165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:27:59 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:00.990709 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:00.990709 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:00.996050 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:00.996495 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:00.997248 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:00.997701 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:01.019345 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:01.069436 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:01.080446 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-e5925f4e-5b22-444f-8ed7-ebc960ef16da tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1243 microversion: 2.1 time: 0.096112 Jun 18 05:28:01.081720 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 580/1166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:00 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1243 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:02.099702 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:02.100288 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:02.107601 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:02.108048 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:02.108815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:02.109654 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:02.182062 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:02.189873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-d905c6c9-e9a5-42c8-badc-1f4284fd3599 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1309 microversion: 2.1 time: 0.094035 Jun 18 05:28:02.192688 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 587/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:02 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:03.206255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:03.209310 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:03.214871 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:03.215323 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:03.216139 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:03.216578 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:03.394398 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:03.411046 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6b749ccd-3dcd-42c4-b435-366102e947e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.208504 Jun 18 05:28:03.411884 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 581/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:03 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:03.707480 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-18c6d62a-e608-44ea-a867-a4f8dba37545 req-7c922e33-28b0-4eb5-9362-5c2452138c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb2f954-4e94-4589-adf4-65340f5655e9", "tag": "2a7614f5-ede4-4e08-914f-d2783c3dee19"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:28:03.710028 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-18c6d62a-e608-44ea-a867-a4f8dba37545 req-7c922e33-28b0-4eb5-9362-5c2452138c49 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:03.711362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-18c6d62a-e608-44ea-a867-a4f8dba37545 req-7c922e33-28b0-4eb5-9362-5c2452138c49 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:03.726851 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-18c6d62a-e608-44ea-a867-a4f8dba37545 req-7c922e33-28b0-4eb5-9362-5c2452138c49 service nova] Creating event network-changed:2a7614f5-ede4-4e08-914f-d2783c3dee19 for instance cdb2f954-4e94-4589-adf4-65340f5655e9 on hv-cinder-83699 Jun 18 05:28:03.732013 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-18c6d62a-e608-44ea-a867-a4f8dba37545 req-7c922e33-28b0-4eb5-9362-5c2452138c49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035755 Jun 18 05:28:03.735244 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 588/1169] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:04.428418 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:04.429771 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:04.436776 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:04.437222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:04.438014 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:04.438447 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:04.586199 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:04.596627 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-41460017-8423-45fc-a4fa-4619c3076e02 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.172401 Jun 18 05:28:04.597282 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 582/1170] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:04 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:05.617721 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:05.618422 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:05.624572 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:05.625017 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:05.625803 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:05.626236 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:05.752861 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:05.760906 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bc52141a-2ea5-454b-bafa-e8f9e733535f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.148702 Jun 18 05:28:05.761479 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 589/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:05 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:06.778457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:06.779070 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:06.781402 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:06.786337 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:06.786786 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:06.787545 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:06.787984 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:06.921058 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:06.928533 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b71f9a2b-2ac8-4a77-bf97-f4ac481775ff tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.153973 Jun 18 05:28:06.929222 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 583/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:06 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:07.946030 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:07.946649 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:07.948615 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=2 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:07.949771 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell0:SELECT=12 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:07.954565 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:07.957191 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:07.957191 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:07.957191 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:08.088227 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:08.096619 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-b4568d28-c3e0-456b-864b-63a692af28e5 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.155059 Jun 18 05:28:08.097334 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 590/1173] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:07 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:08.657087 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [req-18fe22f6-f2a9-4455-be17-5a86adb06f16 req-102d4941-1393-4d15-ab74-c992ad20a1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb2f954-4e94-4589-adf4-65340f5655e9", "name": "network-vif-plugged", "status": "completed", "tag": "2a7614f5-ede4-4e08-914f-d2783c3dee19"}]} {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:28:08.666019 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-18fe22f6-f2a9-4455-be17-5a86adb06f16 req-102d4941-1393-4d15-ab74-c992ad20a1fa service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:08.666460 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [req-18fe22f6-f2a9-4455-be17-5a86adb06f16 req-102d4941-1393-4d15-ab74-c992ad20a1fa service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:08.679134 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.compute.server_external_events [req-18fe22f6-f2a9-4455-be17-5a86adb06f16 req-102d4941-1393-4d15-ab74-c992ad20a1fa service nova] Creating event network-vif-plugged:2a7614f5-ede4-4e08-914f-d2783c3dee19 for instance cdb2f954-4e94-4589-adf4-65340f5655e9 on hv-cinder-83699 Jun 18 05:28:08.684121 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [req-18fe22f6-f2a9-4455-be17-5a86adb06f16 req-102d4941-1393-4d15-ab74-c992ad20a1fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210397 Jun 18 05:28:08.686755 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 584/1174] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:09.113747 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:09.114362 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:09.116629 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:09.121563 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:09.122016 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:09.122779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:09.123218 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:09.252188 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:09.260462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3f1e31e5-47cc-4fe8-8bc7-35e4fdcf6461 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.150538 Jun 18 05:28:09.261042 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 591/1175] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:09 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:10.275098 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell0:SELECT=4 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:10.279969 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:10.280410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:10.286830 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:10.296159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:10.296159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:10.296159 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:10.420343 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:10.428018 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8337d8e8-7443-4b7c-be1b-4a57e9d435c6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1364 microversion: 2.1 time: 0.154401 Jun 18 05:28:10.428605 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 585/1176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:10 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:11.445140 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:11.445804 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:11.452403 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:11.452850 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:11.453636 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:11.454073 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:11.580668 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:11.588707 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-8a885037-d5b4-4da3-9bd5-d1396a3a5560 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1554 microversion: 2.1 time: 0.147461 Jun 18 05:28:11.589276 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 592/1177] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:11 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:28:11.605651 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:11.606164 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:11.612782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:11.615818 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:11.615818 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:11.615818 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:11.695238 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d5945fd9-8379-4f00-888c-bc59f1b15e54 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094170 Jun 18 05:28:11.695977 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 586/1178] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 05:28:11 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:12.922455 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-9a8e1daf-1b02-4dd2-8931-d671474380ff req-c747a511-9720-428e-977e-06493ab0be77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb2f954-4e94-4589-adf4-65340f5655e9", "tag": "2a7614f5-ede4-4e08-914f-d2783c3dee19"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:28:12.930743 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9a8e1daf-1b02-4dd2-8931-d671474380ff req-c747a511-9720-428e-977e-06493ab0be77 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:12.931177 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-9a8e1daf-1b02-4dd2-8931-d671474380ff req-c747a511-9720-428e-977e-06493ab0be77 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:12.943220 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-9a8e1daf-1b02-4dd2-8931-d671474380ff req-c747a511-9720-428e-977e-06493ab0be77 service nova] Creating event network-changed:2a7614f5-ede4-4e08-914f-d2783c3dee19 for instance cdb2f954-4e94-4589-adf4-65340f5655e9 on hv-cinder-83699 Jun 18 05:28:12.948859 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-9a8e1daf-1b02-4dd2-8931-d671474380ff req-c747a511-9720-428e-977e-06493ab0be77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029987 Jun 18 05:28:12.949465 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 593/1179] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:47.213086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=7 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:47.213860 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_cell1:SELECT=32 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:47.217725 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:47.218847 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:47.224850 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:47.226300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:47.226300 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:47.226663 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:47.251454 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6885d60c-0bc5-4219-b136-03f4804a7f74 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/ips" status: 200 len: 149 microversion: 2.1 time: 0.039818 Jun 18 05:28:47.256255 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 587/1180] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:28:47 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:48.850360 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_api:SELECT=5 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:48.851194 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG dbcounter [-] [117991] Writing DB stats nova_cell1:SELECT=42 {{(pid=117991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:48.855496 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edee873f-557b-4e9e-afc5-fd0333ef3fa7"}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:28:48.856642 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:48.863959 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:48.865478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:48.865478 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:48.865695 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:49.610608 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-a2628a38-5eb9-4d79-ad24-67297f17979d tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "POST /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761703 Jun 18 05:28:49.611207 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 594/1181] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 05:28:48 2022] POST /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:57.339512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:57.340003 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:57.341924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG dbcounter [-] [117990] Writing DB stats nova_api:SELECT=2 {{(pid=117990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 05:28:57.347707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:57.348207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:57.348964 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:57.349420 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:57.429417 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lazy-loading 'services' on Instance uuid cdb2f954-4e94-4589-adf4-65340f5655e9 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:28:57.653746 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-0fa0156c-e555-41f2-9d4d-fadede9a563f tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments/edee873f-557b-4e9e-afc5-fd0333ef3fa7" status: 202 len: 0 microversion: 2.1 time: 0.318431 Jun 18 05:28:57.654333 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 588/1182] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 05:28:57 2022] DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments/edee873f-557b-4e9e-afc5-fd0333ef3fa7 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:28:57.664137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:57.665245 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:57.671591 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:57.672074 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:57.672848 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:57.673286 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:57.703503 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-44198e54-884e-46d2-b794-e8eeffa89f06 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043349 Jun 18 05:28:57.704039 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 595/1183] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:28:57 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:28:58.715414 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:58.716482 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:58.722757 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:58.723227 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:58.723973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:58.724410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:58.753624 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-be676b0a-4dfd-49ab-85a2-6bc7bd53825b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043021 Jun 18 05:28:58.754185 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 589/1184] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 05:28:58 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 05:28:58.814122 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:58.816327 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:58.821294 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:58.821727 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:58.822580 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:58.823003 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:58.847910 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Going to try to terminate instance {{(pid=117991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 05:28:59.127899 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-25d3cb52-9f46-4d0c-b3e6-0b8a20096e7c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 204 len: 0 microversion: 2.1 time: 0.318226 Jun 18 05:28:59.128400 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 596/1185] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:28:58 2022] DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 05:28:59.136387 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:28:59.137086 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:28:59.143704 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:59.144177 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:59.144924 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:28:59.145354 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:28:59.276660 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:28:59.285075 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-cf9267a6-0e75-4e51-9e6f-0be60d8fe01b tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1678 microversion: 2.1 time: 0.152502 Jun 18 05:28:59.285674 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 590/1186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:28:59 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:29:00.302898 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:00.303592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:00.310070 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:00.310516 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:00.311273 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:00.311723 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:00.441594 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.policy [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117991) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:29:00.448956 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-860019c1-fb6a-4121-b721-eef7cf455eb6 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1678 microversion: 2.1 time: 0.150288 Jun 18 05:29:00.449541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 597/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:00 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:29:01.466517 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:01.467172 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:01.473800 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:01.474250 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:01.475016 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:01.475453 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:01.543263 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:29:01.550879 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-6d41692c-4c04-43e4-9295-94e13041fb1e tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1611 microversion: 2.1 time: 0.088180 Jun 18 05:29:01.551440 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 591/1188] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:01 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1611 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:29:01.831385 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [req-c14422c6-6e57-4729-b8ad-3159ffbfa24b req-afa27869-95a3-4481-b4ac-7b1ed4b9b0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb2f954-4e94-4589-adf4-65340f5655e9", "name": "network-vif-deleted", "tag": "2a7614f5-ede4-4e08-914f-d2783c3dee19"}]} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:29:01.840181 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c14422c6-6e57-4729-b8ad-3159ffbfa24b req-afa27869-95a3-4481-b4ac-7b1ed4b9b0a7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:01.840815 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [req-c14422c6-6e57-4729-b8ad-3159ffbfa24b req-afa27869-95a3-4481-b4ac-7b1ed4b9b0a7 service nova] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:01.853900 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.compute.server_external_events [req-c14422c6-6e57-4729-b8ad-3159ffbfa24b req-afa27869-95a3-4481-b4ac-7b1ed4b9b0a7 service nova] Creating event network-vif-deleted:2a7614f5-ede4-4e08-914f-d2783c3dee19 for instance cdb2f954-4e94-4589-adf4-65340f5655e9 on hv-cinder-83699 Jun 18 05:29:01.860330 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [req-c14422c6-6e57-4729-b8ad-3159ffbfa24b req-afa27869-95a3-4481-b4ac-7b1ed4b9b0a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159039 Jun 18 05:29:01.861333 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 598/1189] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 05:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:29:02.568207 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:02.568747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:02.575457 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:02.575903 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:02.576712 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:02.577148 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:02.611887 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:02.612336 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:02.612802 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.objects.instance [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lazy-loading 'fault' on Instance uuid cdb2f954-4e94-4589-adf4-65340f5655e9 {{(pid=117990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 05:29:02.673142 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.policy [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5dc9999f6664c23855b66670f7d6a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c38b2c1ae4484bbf2d4939470f45e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117990) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 05:29:02.686775 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bd6027e9-a178-451b-aeae-596e501af4e3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 200 len: 1329 microversion: 2.1 time: 0.122044 Jun 18 05:29:02.704492 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 592/1190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:02 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 1329 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 05:29:03.712755 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:03.713512 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:03.720402 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:03.720845 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:03.721635 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:03.722071 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:03.735825 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 HTTP/1.1 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:29:03.737442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:03.739104 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'cdb2f954-4e94-4589-adf4-65340f5655e9'} Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:03.740056 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:03.741662 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:03.742997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:03.742997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-50d6e3aa-4a95-461d-8f58-d3d32b7025ce tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 404 len: 111 microversion: 2.1 time: 0.030796 Jun 18 05:29:03.742997 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 599/1191] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:03 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:03.747815 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-d3e9839d-d280-4b70-8b16-ed039deb2927 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '.version_select at 0x7f7b01e78f70>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:03.826109 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-d3e9839d-d280-4b70-8b16-ed039deb2927 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973874804" status: 202 len: 0 microversion: 2.1 time: 0.082073 Jun 18 05:29:03.826683 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 593/1192] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 05:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973874804 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:29:05.863949 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:05.864477 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:05.870873 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:05.871317 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:05.872082 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:05.872509 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:05.892063 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 HTTP/1.1 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:29:05.893647 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.895253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'cdb2f954-4e94-4589-adf4-65340f5655e9'} Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:05.896343 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.897870 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.899700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:05.899700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-2a37d087-b7a6-4e0a-bf67-b846f790f630 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 404 len: 111 microversion: 2.1 time: 0.034916 Jun 18 05:29:05.899700 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 600/1193] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:29:05 2022] DELETE /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:05.903955 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:05.904602 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: cdb2f954-4e94-4589-adf4-65340f5655e9] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:05.913595 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:05.914047 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:05.914804 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:05.915242 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:05.928512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 HTTP/1.1 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:29:05.930178 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.931907 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'cdb2f954-4e94-4589-adf4-65340f5655e9'} Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:05.933017 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. Jun 18 05:29:05.934544 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:05.936076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance cdb2f954-4e94-4589-adf4-65340f5655e9 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:05.936076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-fb91e1d1-5b51-4c05-8a4a-2d4afd3df6d4 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9" status: 404 len: 111 microversion: 2.1 time: 0.032043 Jun 18 05:29:05.936076 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 594/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:05 2022] GET /compute/v2.1/servers/cdb2f954-4e94-4589-adf4-65340f5655e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:07.193687 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:07.194210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:07.200673 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.201117 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.201901 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.202369 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.216212 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e HTTP/1.1 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:29:07.217779 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.220055 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '5d6c072b-d718-4472-84dd-c382b4a3c51e'} Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:07.221303 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.222809 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.224739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:07.224739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-c76392d8-2ac5-43b4-bf53-1e632ebbdf96 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 404 len: 111 microversion: 2.1 time: 0.029349 Jun 18 05:29:07.224739 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 601/1195] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:29:07 2022] DELETE /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:07.228265 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:07.228881 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 5d6c072b-d718-4472-84dd-c382b4a3c51e] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:07.235359 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.235986 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.236752 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.237217 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.251512 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e HTTP/1.1 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:29:07.253035 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.254784 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '5d6c072b-d718-4472-84dd-c382b4a3c51e'} Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:07.255707 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. Jun 18 05:29:07.257224 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.258470 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance 5d6c072b-d718-4472-84dd-c382b4a3c51e could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:07.258470 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-8b948729-50b9-42d6-8df6-c3d0b1d3105c tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e" status: 404 len: 111 microversion: 2.1 time: 0.030090 Jun 18 05:29:07.258470 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 595/1196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:07 2022] GET /compute/v2.1/servers/5d6c072b-d718-4472-84dd-c382b4a3c51e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:07.262692 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:07.263185 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:07.270377 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.270819 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.271568 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.271996 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.285755 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 HTTP/1.1 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:29:07.287271 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.288926 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'c87d5fa9-8c4d-4486-8fa8-dab86dcdb126'} Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:07.289793 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.291149 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.292390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:07.292390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-71818cb2-9fbe-4971-b642-ca87793cdec3 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 404 len: 111 microversion: 2.1 time: 0.029725 Jun 18 05:29:07.292390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 602/1197] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:29:07 2022] DELETE /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:07.296904 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:07.297573 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: c87d5fa9-8c4d-4486-8fa8-dab86dcdb126] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:07.303514 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.303962 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.304716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:07.305170 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:07.318583 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 HTTP/1.1 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:29:07.320147 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.321778 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': 'c87d5fa9-8c4d-4486-8fa8-dab86dcdb126'} Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:07.322787 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. Jun 18 05:29:07.324274 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:07.325747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:07.325747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-edcccb35-f471-4d78-9069-94258ead4812 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126" status: 404 len: 111 microversion: 2.1 time: 0.028424 Jun 18 05:29:07.325747 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 596/1198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:07 2022] GET /compute/v2.1/servers/c87d5fa9-8c4d-4486-8fa8-dab86dcdb126 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:08.589869 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:08.590390 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.compute.api [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117991) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:08.597068 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:08.597541 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:08.598301 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:08.598734 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG oslo_concurrency.lockutils [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:08.612332 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 HTTP/1.1 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:29:08.613914 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: > Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.615507 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': '589899a5-db4e-4c26-9411-811a83bd6f35'} Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:08.616462 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.617952 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.619579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:08.619579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-1de9f33e-e567-4879-92a8-8e21dc825112 tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 404 len: 111 microversion: 2.1 time: 0.029230 Jun 18 05:29:08.619579 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 603/1199] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 05:29:08 2022] DELETE /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:08.623523 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Calling method '>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:08.624165 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.compute.api [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] [instance: 589899a5-db4e-4c26-9411-811a83bd6f35] Fetching instance by UUID {{(pid=117990) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 05:29:08.631275 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:08.631716 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:08.632464 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 05:29:08.632894 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG oslo_concurrency.lockutils [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Lock "3d1210af-aec7-4375-9a06-dcb0a464d0d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 05:29:08.646696 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.wsgi [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] HTTP exception thrown: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Request method failure captured: Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: request: GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 HTTP/1.1 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept: application/json Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Accept-Encoding: identity Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Connection: close Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Length: 0 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Content-Type: application/json Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Host: 10.222.0.23 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Openstack-System-Scope: None Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Auth-Token: gAAAAABirWFqauk2wU--ESJgmFNazRchkS1PbL9wkFa_LYvhTQtDf9Ws9voTnD7bmHYcI3auM4J6LNSbtxoeFKsdJR8lWp_kQ_zWBzNjWmhT0FJuIZE6EQh1eXVRiYIbOhH7WTrusCsnTQjhMvJO9QIhXxUhhE2aHBt81LKauzFdzY22XPb6YP0 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Id: None Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Domain-Name: None Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Identity-Status: Confirmed Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Is-Admin-Project: True Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Id: default Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Domain-Name: Default Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Project-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Role: reader,member Jun 18 05:29:08.648141 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Roles: reader,member Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81c38b2c1ae4484bbf2d4939470f45e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81c38b2c1ae4484bbf2d4939470f45e4"}]}] Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Id: 81c38b2c1ae4484bbf2d4939470f45e4 Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1030731986 Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Id: default Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Domain-Name: Default Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Id: e5dc9999f6664c23855b66670f7d6a98 Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: X-User-Name: tempest-AttachVolumeNegativeTest-1030731986-project Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: method: > Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: exception: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.649765 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: action_args: {'id': '589899a5-db4e-4c26-9411-811a83bd6f35'} Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:08.650816 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. Jun 18 05:29:08.652332 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: ERROR nova.api.openstack.wsgi Jun 18 05:29:08.654006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] Returning 404 to user: Instance 589899a5-db4e-4c26-9411-811a83bd6f35 could not be found. {{(pid=117990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:08.654006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-b811b397-9dd8-45cd-abf2-d23d7bebecfc tempest-AttachVolumeNegativeTest-1030731986 tempest-AttachVolumeNegativeTest-1030731986-project] 10.222.0.23 "GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35" status: 404 len: 111 microversion: 2.1 time: 0.029800 Jun 18 05:29:08.654006 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 597/1200] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 05:29:08 2022] GET /compute/v2.1/servers/589899a5-db4e-4c26-9411-811a83bd6f35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:29:14.384210 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-3ae7344c-64be-40ec-a4a5-e3ba8cd357dd tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Action: 'create', calling method: .version_select at 0x7f7b05f8f940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-452452021", "metadata": {"Type": "work"}}} {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 05:29:15.003280 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-3ae7344c-64be-40ec-a4a5-e3ba8cd357dd tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.731477 Jun 18 05:29:15.003923 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 604/1201] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 05:29:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 733 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 18 05:29:15.014723 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-c335ea1c-0e2f-4e5b-a4f8-fd50c1cda7b5 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Calling method '.version_select at 0x7f7b01483160>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:15.062572 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-c335ea1c-0e2f-4e5b-a4f8-fd50c1cda7b5 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0" status: 200 len: 352 microversion: 2.1 time: 0.051646 Jun 18 05:29:15.063662 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 598/1202] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:29:15 2022] GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:29:16.076137 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-e5a772eb-6f16-49b6-9443-7bb9aa82cdfc tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Calling method '.version_select at 0x7f7b00ec89d0>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:16.123240 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-e5a772eb-6f16-49b6-9443-7bb9aa82cdfc tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0" status: 200 len: 353 microversion: 2.1 time: 0.051347 Jun 18 05:29:16.123800 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 605/1203] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:29:16 2022] GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:29:16.134833 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-bee39523-14d3-4ec9-8f08-2337831e03b2 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Calling method '.version_select at 0x7f7b01e87670>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:16.185410 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-bee39523-14d3-4ec9-8f08-2337831e03b2 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0" status: 200 len: 353 microversion: 2.1 time: 0.054649 Jun 18 05:29:16.186097 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 599/1204] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:29:16 2022] GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:29:16.202308 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-db61274f-7a30-4c13-84d3-79516eb34485 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Calling method '.version_select at 0x7f7b00faef70>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:16.390442 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-db61274f-7a30-4c13-84d3-79516eb34485 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0" status: 202 len: 0 microversion: 2.1 time: 0.191990 Jun 18 05:29:16.391044 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 606/1205] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 05:29:16 2022] DELETE /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 05:29:16.399648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: DEBUG nova.api.openstack.wsgi [None req-04ac2aaf-6aae-407e-8fbd-b0181cdf2e96 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Calling method '.version_select at 0x7f7b0202d0d0>' {{(pid=117990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:16.447648 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO nova.api.openstack.requestlog [None req-04ac2aaf-6aae-407e-8fbd-b0181cdf2e96 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0" status: 200 len: 352 microversion: 2.1 time: 0.052204 Jun 18 05:29:16.448223 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: [pid: 117990|app: 0|req: 600/1206] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:29:16 2022] GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 05:29:17.460463 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bdee2c96-af8d-40ea-a535-7e89ef819dd3 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Calling method '.version_select at 0x7f7b01003280>' {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 05:29:17.487574 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.wsgi [None req-bdee2c96-af8d-40ea-a535-7e89ef819dd3 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] HTTP exception thrown: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bdee2c96-af8d-40ea-a535-7e89ef819dd3 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Request method failure captured: Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: request: GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 HTTP/1.1 Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept: application/json Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Accept-Encoding: identity Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Connection: close Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Length: 0 Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Content-Type: application/json Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Host: 10.222.0.23 Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Openstack-System-Scope: None Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: User-Agent: python-urllib3/1.26.9 Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Auth-Token: gAAAAABirWKqjQa4bNY55FKy5xxrSDu--__eYykxnEw1v0-tY1f6kyQvsWRnkTrfwI_ai1acNiv0WvKksPlUuUfU55yQJ9U4TWH0s837BRkTQHvnJmeooQNm7AeMm33C8h3fsY8xzxOq58aLQ87ebjmLrE2rKD3NqrKulXonnlrzr5NJQNjG5ak Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Id: None Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Domain-Name: None Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Identity-Status: Confirmed Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Is-Admin-Project: True Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Id: default Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Domain-Name: Default Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Id: 98b2c0715f93458785782dfe3574d15c Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Project-Name: tempest-VolumesGetTestJSON-2068566014 Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Role: reader,member Jun 18 05:29:17.489586 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Roles: reader,member Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98b2c0715f93458785782dfe3574d15c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98b2c0715f93458785782dfe3574d15c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98b2c0715f93458785782dfe3574d15c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98b2c0715f93458785782dfe3574d15c"}]}] Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant: tempest-VolumesGetTestJSON-2068566014 Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Id: 98b2c0715f93458785782dfe3574d15c Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-Tenant-Name: tempest-VolumesGetTestJSON-2068566014 Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User: tempest-VolumesGetTestJSON-2068566014-project Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Id: default Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Domain-Name: Default Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Id: a1ab6b547b02449c9d9e2026df4aab0d Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: X-User-Name: tempest-VolumesGetTestJSON-2068566014-project Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: method: Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: exception: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: action_args: {'id': 'a7088955-757e-41e9-bb05-15d0e00122d0'} Jun 18 05:29:17.491204 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: {{(pid=117991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. (HTTP 404) (Request-ID: req-87d54b45-3d91-47be-8d2e-b53c3b9e0f23) Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:17.492471 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 05:29:17.493974 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 05:29:17.495612 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: ERROR nova.api.openstack.wsgi Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: DEBUG nova.api.openstack.wsgi [None req-bdee2c96-af8d-40ea-a535-7e89ef819dd3 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] Returning 404 to user: Volume a7088955-757e-41e9-bb05-15d0e00122d0 could not be found. {{(pid=117991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO nova.api.openstack.requestlog [None req-bdee2c96-af8d-40ea-a535-7e89ef819dd3 tempest-VolumesGetTestJSON-2068566014 tempest-VolumesGetTestJSON-2068566014-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0" status: 404 len: 109 microversion: 2.1 time: 0.034817 Jun 18 05:29:17.497592 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: [pid: 117991|app: 0|req: 607/1207] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 05:29:17 2022] GET /compute/v2.1/os-volumes/a7088955-757e-41e9-bb05-15d0e00122d0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 05:30:02.343500 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:30:02.343973 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:30:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:30:11.801184 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:30:11.801792 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Sat Jun 18 05:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:31:42.325318 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:31:42.325968 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:31:55.809917 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:31:55.810497 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Sat Jun 18 05:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:32:10.336335 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:32:10.336966 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:32:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:33:22.153939 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:33:22.154446 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Sat Jun 18 05:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:33:22.352555 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:33:22.353094 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:33:31.809763 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:33:31.810253 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Sat Jun 18 05:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:35:02.333782 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:35:02.334409 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:35:15.818198 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:35:15.818712 dv-cinder-836996-35-iscsi devstack@n-api.service[117991]: Sat Jun 18 05:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 05:35:30.344260 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 05:35:30.344851 dv-cinder-836996-35-iscsi devstack@n-api.service[117990]: Sat Jun 18 05:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!